00000001:02000400:3.0F:1787906615.665416:0:2957:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787906642.302383:0:3178:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1787906644.994024:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 362 MB/s 00000001:01000000:2.0F:1787906645.244188:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 475 MB/s 00000001:01000000:3.0:1787906645.495085:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2800 MB/s 00000020:02000000:2.0:1787906646.794657:0:3269:0:(class_obd.c:789:obdclass_init()) Lustre: Build Version: 2.17.57_85_g0128fd2 00000400:02000000:1.0F:1787906647.701226:0:3284:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.120@tcp [8/256/0/180] 00008000:02000000:3.0:1787906651.902485:0:3434:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787906713.031599:0:5237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787906724.324574:0:5811:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787906724.324586:0:5811:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787906724.324804:0:5811:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c7afd1ec 00000080:02000400:0.0:1787906724.324873:0:5811:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787906724.332685:0:5811:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787906724.332711:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787906724.332792:0:5811:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002ea4d092) 00000020:00000080:0.0:1787906724.333038:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787906724.368610:0:5811:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787906724.369929:0:5811:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787906724.421020:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787906724.421075:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787906724.421099:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787906724.421158:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787906724.421190:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787906724.423068:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787906724.423085:0:5811:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787906724.423101:0:5811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bb6cf063cacf39 00000020:01000004:3.0:1787906724.423113:0:5811:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787906724.423120:0:5811:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787906724.423128:0:5811:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c7afd1ec from MGS 00000020:01000004:3.0:1787906724.423135:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787906724.423178:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000d8081295) 00000020:00000080:3.0:1787906724.423201:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787906724.423296:0:5811:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c7afd1ec from MGS, refs=2 00080000:01000000:3.0:1787906724.423315:0:5811:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787906724.423328:0:5811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bb6cf063cacf47 00000100:00100000:3.0:1787906724.424127:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787906724.424808:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787906724.424851:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787906724.425887:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787906724.425899:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787906724.427622:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787906724.428367:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787906724.428379:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787906724.442744:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787906724.442778:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787906724.445511:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787906724.445540:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787906724.447614:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906724.447623:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906724.447626:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906724.460769:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906724.460779:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906724.460782:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906724.462470:0:5811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787906724.478438:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787906724.712095:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2071 MB/s 00000001:01000000:2.0:1787906724.961887:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2011 MB/s 00000001:01000000:3.0:1787906725.212386:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 523 MB/s 00000001:01000000:2.0:1787906725.462904:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 525 MB/s 00080000:10000000:1.0:1787906725.516954:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1787906725.536418:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787906725.557482:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787906725.557508:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787906725.557511:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787906725.560858:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787906725.560975:0:5811:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787906725.561082:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787906725.565686:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787906725.565762:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787906725.566544:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787906725.566839:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787906725.566848:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787906725.574773:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787906725.574791:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787906725.577156:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787906725.577176:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787906725.582874:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787906725.582917:0:5811:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.120@tcp' 00000020:01000004:0.0:1787906725.582920:0:5811:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787906725.583002:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.120@tcp (typ=mgc) 00000020:00000080:0.0:1787906725.583022:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.120@tcp (000000007b759abf) 00000020:00000080:0.0:1787906725.583048:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787906725.583194:0:5811:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001c8bebf6@MGC192.168.204.120@tcp: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1787906725.583446:0:5811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.120@tcp-0 is initialized 00000040:01000000:0.0:1787906725.583457:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787906725.584264:0:5826:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787906725.595610:0:5827:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787906725.595944:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.120@tcp (uuid 17707cff-d1ec-407e-b5de-6f2bf29614ad) 00000020:00000080:1.0:1787906725.595977:0:5811:0:(genops.c:1385:class_connect()) connect: client 17707cff-d1ec-407e-b5de-6f2bf29614ad, cookie 0x72bb6cf063cacf55 00000100:00080000:1.0:1787906725.595994:0:5811:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787906725.596000:0:5811:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import 000000001c8bebf6 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1787906725.596067:0:5811:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000c16327b x1874756000284800/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787906725.596101:0:5811:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 17707cff-d1ec-407e-b5de-6f2bf29614ad->MGS 00000020:01000004:1.0:1787906725.596126:0:5811:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787906725.596132:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787906725.596158:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b93a03f5) 00000020:00000080:1.0:1787906725.596175:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787906725.596931:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c16327b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17707cff-d1ec-407e-b5de-6f2bf29614ad:3300:1874756000284800:0@lo:250: 00000100:00100000:0.0:1787906725.600394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906725.600645:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000284800 00000100:00100000:0.0:1787906725.600659:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000284800 00000100:00100000:0.0:1787906725.601015:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787906725.601026:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000587364d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3300:x1874756000284800:12345-0@lo:250: 00010000:00080000:0.0:1787906725.601067:0:5823:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 17707cff-d1ec-407e-b5de-6f2bf29614ad@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:0.0:1787906725.601112:0:5823:0:(genops.c:1385:class_connect()) connect: client 17707cff-d1ec-407e-b5de-6f2bf29614ad, cookie 0x72bb6cf063cacf63 00000100:00080000:0.0:1787906725.601301:0:5823:0:(import.c:65:import_set_state_nolock()) 00000000f89e7b14 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787906725.601390:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000587364d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+5:3300:x1874756000284800:12345-0@lo:250: Request processed in 364us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906725.601410:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787906725.601639:0:3300:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787906725.601652:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.120@tcp: connect to target with instance 0 00000100:00080000:0.0:1787906725.601662:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787906725.601668:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787906725.601671:0:3300:0:(import.c:65:import_set_state_nolock()) 000000001c8bebf6 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787906725.601674:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787906725.601678:0:3300:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787906725.601684:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c16327b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17707cff-d1ec-407e-b5de-6f2bf29614ad:3300:1874756000284800:0@lo:250: 00000100:00100000:0.0:1787906725.628262:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787906725.628524:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787906725.628534:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787906725.631885:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787906725.631906:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787906725.635491:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787906725.635517:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787906725.644041:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787906725.644332:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787906725.644345:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787906725.646750:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787906725.646769:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787906725.720139:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787906725.720995:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787906725.721003:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787906725.723073:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787906725.723090:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787906725.730370:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787906725.730604:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787906725.730612:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787906725.734858:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787906725.734874:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787906725.735659:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787906725.735944:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787906725.735950:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787906725.736667:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787906725.736686:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787906725.738291:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787906725.738489:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787906725.738495:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787906725.740210:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787906725.740224:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787906725.776792:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787906725.777237:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787906725.777244:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787906725.786283:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787906725.786304:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787906725.790202:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787906725.790233:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787906725.793506:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787906725.793534:0:5811:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787906725.793540:0:5811:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787906725.793669:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787906725.793703:0:5811:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787906725.793708:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787906725.793709:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787906725.793715:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787906725.793716:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787906725.793717:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787906725.793717:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787906725.793719:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787906725.793733:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787906725.793734:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787906725.793735:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787906725.793736:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787906725.793738:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787906725.793740:0:5811:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787906725.793742:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787906725.793743:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787906725.793744:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787906725.793745:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787906725.793746:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787906725.793747:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787906725.793748:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787906725.793748:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787906725.793749:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787906725.793750:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787906725.793751:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787906725.793751:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787906725.793794:0:5811:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787906725.793845:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6866823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000284928:0@lo:253: 00000100:00100000:2.0:1787906725.793930:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906725.793977:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b279cb2e going to sleep for 11 seconds 00000100:00100000:0.0:1787906725.794284:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000284928 00000100:00100000:0.0:1787906725.794293:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000284928 00000100:00100000:0.0:1787906725.794341:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787906725.794350:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098d22c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+5:5811:x1874756000284928:12345-0@lo:253: 20000000:01000000:0.0:1787906725.794410:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787906725.794414:0:5825:0:(mgs_handler.c:480:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787906725.794730:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787906725.794786:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787906725.795175:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787906725.796264:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787906725.796586:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787906725.796592:0:5825:0:(mgs_handler.c:538:mgs_target_reg()) Checking nodemap for target registration lustre-MDT0000 20000000:01000000:1.0:1787906725.796595:0:5825:0:(mgs_handler.c:544:mgs_target_reg()) lustre-MDT0000: Nodemap subsystem disabled, allowing target registration 20000000:01000000:1.0:1787906725.796600:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787906725.796606:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787906725.796609:0:5825:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787906725.796626:0:5825:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787906725.797146:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787906725.797347:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787906725.797361:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787906725.797412:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787906725.797457:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787906725.797493:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787906725.797581:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787906725.797589:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787906725.797636:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787906725.797644:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787906725.797677:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787906725.797684:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787906725.797717:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787906725.798243:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787906725.798289:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787906725.798295:0:5825:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787906725.798309:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787906725.798516:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787906725.798527:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787906725.798560:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787906725.798595:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787906725.798640:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787906725.798671:0:5825:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787906725.798759:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787906725.798768:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787906725.798845:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787906725.798884:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787906725.798918:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787906725.798928:0:5825:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787906725.799100:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787906725.799112:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787906725.799150:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787906725.799186:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787906725.799358:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787906725.799409:0:5825:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787906725.799417:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787906725.800540:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787906725.801095:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787906725.801125:0:5825:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.120@tcp for mdt 20000000:01000000:0.0:1787906725.801128:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:0.0:1787906725.801169:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787906725.801177:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787906725.801208:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787906725.801216:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:0.0:1787906725.801259:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787906725.801270:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787906725.801300:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787906725.801335:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787906725.801406:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787906725.801409:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787906725.801413:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787906725.801425:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787906725.801428:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787906725.801472:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787906725.801474:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787906725.801993:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787906725.802347:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787906725.802392:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787906725.802459:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787906725.802472:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787906725.802474:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787906725.802963:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787906725.803266:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787906725.803306:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787906725.803340:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1787906725.803354:0:5825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787906725.803356:0:5825:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787906725.803362:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787906725.803366:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787906725.803372:0:5825:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787906725.803378:0:5825:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787906725.803703:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787906725.803931:0:5825:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787906725.814187:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787906725.814267:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787906725.814383:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787906725.814804:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787906725.814890:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d071e261/0x72bb6cf063cacf6a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.814918:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d071e261/0x72bb6cf063cacf6a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.814933:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d071e261/0x72bb6cf063cacf6a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.814941:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d071e261/0x72bb6cf063cacf6a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.814972:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d071e261/0x72bb6cf063cacf6a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.814980:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d071e261/0x72bb6cf063cacf6a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.814987:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d071e261 already unused, calling callback (00000000c6a0f0dc) 00010000:00010000:0.0:1787906725.814992:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d071e261/0x72bb6cf063cacf6a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.815000:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d071e261/0x72bb6cf063cacf6a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.815016:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d071e261/0x72bb6cf063cacf6a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.815025:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d071e261/0x72bb6cf063cacf6a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.815032:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d071e261/0x72bb6cf063cacf6a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787906725.815058:0:5825:0:(mgs_handler.c:675:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787906725.976305:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098d22c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+5:5811:x1874756000284928:12345-0@lo:253: Request processed in 181948us (182368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906725.976325:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787906725.976508:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6866823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000284928:0@lo:253: 10000000:01000000:0.0:1787906725.976529:0:5811:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787906725.976532:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787906725.976535:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787906725.976536:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787906725.976538:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787906725.976539:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787906725.976558:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787906725.976559:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787906725.976561:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787906725.976563:0:5811:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787906725.976565:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787906725.976566:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787906725.976586:0:5811:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c7afd1ec from lustre-MDT0000 10000000:01000000:0.0:1787906725.976612:0:5811:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787906725.976615:0:5811:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787906725.976619:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8aa510bd0000 10000000:01000000:0.0:1787906725.976624:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787906725.976631:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8aa510bd0000 from 1 10000000:01000000:0.0:1787906725.976634:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787906725.976689:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000d071e261/0x72bb6cf063cacf71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.976699:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000d071e261/0x72bb6cf063cacf71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.976707:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000d071e261/0x72bb6cf063cacf71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906725.976736:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f01f3269 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000285056:0@lo:101: 00000100:00100000:0.0:1787906725.976779:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906725.976945:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b576f17 going to sleep for 11 seconds 00000100:00100000:2.0:1787906725.977013:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000285056 00000100:00100000:2.0:1787906725.977020:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000285056 00000100:00100000:2.0:1787906725.977182:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787906725.977196:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000076c0157 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+5:5811:x1874756000285056:12345-0@lo:101: 00010000:00010000:2.0:1787906725.977216:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906725.977233:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000bab873d/0x72bb6cf063cacf78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cacf71 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906725.977265:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000bab873d/0x72bb6cf063cacf78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cacf71 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906725.977273:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000bab873d/0x72bb6cf063cacf78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cacf71 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906725.977282:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000bab873d, rc 0) 00000100:00100000:2.0:1787906725.977358:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000076c0157 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+6:5811:x1874756000285056:12345-0@lo:101: Request processed in 166us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906725.977364:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787906725.977532:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f01f3269 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000285056:0@lo:101: 00010000:00010000:0.0:1787906725.977548:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000d071e261/0x72bb6cf063cacf71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacf78 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.977557:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000d071e261/0x72bb6cf063cacf71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cacf78 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906725.977614:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f01f3269 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000285184:0@lo:501: 00000100:00100000:0.0:1787906725.977638:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906725.977663:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b576f17 going to sleep for 11 seconds 00000100:00100000:2.0:1787906725.977696:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000285184 00000100:00100000:2.0:1787906725.977701:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000285184 00000100:00100000:2.0:1787906725.977766:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787906725.977772:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000134ab584 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+6:5811:x1874756000285184:12345-0@lo:501: 00000100:00100000:2.0:1787906725.978048:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000134ab584 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+6:5811:x1874756000285184:12345-0@lo:501: Request processed in 276us (408us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787906725.978068:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787906725.978223:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f01f3269 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000285184:0@lo:501: 10000000:01000000:0.0:1787906725.978252:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787906725.978305:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000d071e261/0x72bb6cf063cacf71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacf78 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.978313:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000d071e261/0x72bb6cf063cacf71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacf78 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906725.978321:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8aa51a4db800 10000000:01000000:0.0:1787906725.978325:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787906725.978329:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8aa51a4db800 10000000:01000000:0.0:1787906725.978331:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787906725.978334:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8aa51a4db800 from 1 10000000:01000000:0.0:1787906725.978336:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787906725.978353:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 0000000049692f2e/0x72bb6cf063cacf7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.978359:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 0000000049692f2e/0x72bb6cf063cacf7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.978367:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 0000000049692f2e/0x72bb6cf063cacf7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906725.978379:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f01f3269 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000285312:0@lo:101: 00000100:00100000:0.0:1787906725.978509:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906725.978537:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b576f17 going to sleep for 11 seconds 00000100:00100000:1.0:1787906725.978594:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000285312 00000100:00100000:1.0:1787906725.978601:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000285312 00000100:00100000:1.0:1787906725.978634:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787906725.978640:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fb71d56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+6:5811:x1874756000285312:12345-0@lo:101: 00010000:00010000:1.0:1787906725.978649:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906725.978661:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e6d124a9/0x72bb6cf063cacf86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cacf7f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906725.978676:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6d124a9/0x72bb6cf063cacf86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cacf7f expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906725.978685:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e6d124a9/0x72bb6cf063cacf86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cacf7f expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906725.978692:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e6d124a9, rc 0) 00000100:00100000:1.0:1787906725.978751:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fb71d56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+7:5811:x1874756000285312:12345-0@lo:101: Request processed in 111us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906725.978757:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787906725.978850:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f01f3269 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000285312:0@lo:101: 00010000:00010000:0.0:1787906725.978860:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 0000000049692f2e/0x72bb6cf063cacf7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.978867:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 0000000049692f2e/0x72bb6cf063cacf7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906725.978877:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787906725.979117:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 0000000049692f2e/0x72bb6cf063cacf7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.979125:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 0000000049692f2e/0x72bb6cf063cacf7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906725.979132:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787906725.979135:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787906725.979141:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8aa51a4db800 10000000:01000000:0.0:1787906725.979143:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787906725.979146:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787906725.979148:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787906725.979164:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 000000009a94bcd1/0x72bb6cf063cacf8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.979170:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 000000009a94bcd1/0x72bb6cf063cacf8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906725.979176:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 000000009a94bcd1/0x72bb6cf063cacf8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906725.979194:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f01f3269 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000285440:0@lo:101: 00000100:00100000:0.0:1787906725.979273:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906725.979346:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000285440 00000100:00100000:0.0:1787906725.979355:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b576f17 going to sleep for 11 seconds 00000100:00100000:3.0:1787906725.979361:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000285440 00000100:00100000:3.0:1787906725.979512:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787906725.979520:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a7a3007 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+7:5811:x1874756000285440:12345-0@lo:101: 00010000:00010000:3.0:1787906725.979529:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906725.979538:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000092cb928d/0x72bb6cf063cacf94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cacf8d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906725.979558:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000092cb928d/0x72bb6cf063cacf94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cacf8d expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906725.979575:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000092cb928d/0x72bb6cf063cacf94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cacf8d expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906725.979583:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000092cb928d, rc 0) 00000100:00100000:3.0:1787906725.979627:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a7a3007 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+8:5811:x1874756000285440:12345-0@lo:101: Request processed in 108us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906725.979640:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787906725.979711:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f01f3269 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000285440:0@lo:101: 00010000:00010000:2.0:1787906725.979732:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 000000009a94bcd1/0x72bb6cf063cacf8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacf94 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906725.979739:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 000000009a94bcd1/0x72bb6cf063cacf8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cacf94 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906725.979785:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027e808ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000285568:0@lo:501: 00000100:00100000:2.0:1787906725.979972:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906725.980314:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 0000000045f2453b going to sleep for 11 seconds 00000100:00100000:0.0:1787906725.980378:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000285568 00000100:00100000:0.0:1787906725.980383:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000285568 00000100:00100000:0.0:1787906725.980403:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787906725.980408:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079be207a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+8:5811:x1874756000285568:12345-0@lo:501: 00000100:00100000:0.0:1787906725.981303:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079be207a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+9:5811:x1874756000285568:12345-0@lo:501: Request processed in 891us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906725.981314:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787906725.981412:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027e808ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000285568:0@lo:501: 00000100:00100000:2.0:1787906725.981511:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027e808ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000285696:0@lo:503: 00000100:00100000:2.0:1787906725.981555:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906725.981773:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000285696 00000100:00100000:3.0:1787906725.981780:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000285696 00000100:00100000:2.0:1787906725.981780:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 0000000045f2453b going to sleep for 11 seconds 00000100:00100000:3.0:1787906725.981837:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787906725.981845:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb690f39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+9:5811:x1874756000285696:12345-0@lo:503: 00000100:00100000:3.0:1787906725.982087:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb690f39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+9:5811:x1874756000285696:12345-0@lo:503: Request processed in 244us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906725.982094:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787906725.982225:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027e808ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000285696:0@lo:503: 00000100:00100000:2.0:1787906725.982945:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027e808ee pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:5853:1874756000285824:0@lo:502: 00000100:00100000:2.0:1787906725.982997:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906725.983031:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c09d49db going to sleep for 11 seconds 00000100:00100000:0.0:1787906725.983109:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000285824 00000100:00100000:0.0:1787906725.983115:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000285824 00000100:00100000:0.0:1787906725.983199:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787906725.983207:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042f5f31f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+9:5853:x1874756000285824:12345-0@lo:502: 00000100:00100000:0.0:1787906725.983509:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042f5f31f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+9:5853:x1874756000285824:12345-0@lo:502: Request processed in 303us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906725.983518:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787906725.983573:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027e808ee pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:5853:1874756000285824:0@lo:502: 00000020:01000000:2.0:1787906725.983601:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787906725.983614:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906725.983617:0:5853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787906725.983622:0:5853:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787906725.983624:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787906725.983646:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000047b6d89d) 00000020:00000080:2.0:1787906725.983664:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787906725.983672:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787906725.983858:0:5853:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787906725.983866:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bb6cf063cacfa2 00000020:00000080:2.0:1787906725.984087:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787906725.984092:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787906725.984095:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906725.984097:0:5853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787906725.984100:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787906725.984104:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906725.984105:0:5853:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787906725.984108:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787906725.984115:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009cdcc14c) 00000020:00000080:2.0:1787906725.984130:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787906725.984134:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787906725.984136:0:5853:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787906725.984138:0:5853:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787906725.984145:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787906725.984195:0:5853:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c7afd1ec from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787906725.984206:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000050c65b7c) 00000020:00000080:2.0:1787906725.984214:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787906725.984272:0:5853:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787906725.984278:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bb6cf063cacfb7 00000020:00000080:2.0:1787906725.984366:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787906725.984373:0:5853:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787906725.984384:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x72bb6cf063cacfbe 00080000:01000000:2.0:1787906725.984391:0:5853:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787906725.984396:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bb6cf063cacfc5 00080000:10000000:2.0:1787906725.985113:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1787906725.985320:0:5853:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787906725.989301:0:5853:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787906726.046443:0:5853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787906726.046964:0:5853:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787906726.049211:0:5853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787906726.049535:0:5853:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787906726.133455:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000091bcacd6) 00000020:00000080:2.0:1787906726.133487:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787906726.133576:0:5853:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787906726.133583:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bb6cf063cacfd3 00000020:00000080:2.0:1787906726.136301:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787906726.137540:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787906726.240588:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787906726.360481:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787906726.443521:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787906726.518255:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787906726.559089:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:3.0:1787906726.561704:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787906726.584766:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x72bb6cf063cacfda 00000020:00000080:1.0:1787906726.585658:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787906726.585675:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787906726.585683:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787906726.585686:0:5853:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787906726.585690:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787906726.585695:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787906726.585696:0:5853:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787906726.585699:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787906726.585701:0:5853:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787906726.585703:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787906726.585718:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787906726.585728:0:5853:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787906726.585731:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787906726.585737:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787906726.585738:0:5853:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787906726.585743:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787906726.585793:0:5853:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787906726.585898:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:5853:1874756000285952:0@lo:502: 00000100:00100000:1.0:1787906726.586109:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906726.586222:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3267f61 going to sleep for 11 seconds 00000100:00100000:0.0:1787906726.586280:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000285952 00000100:00100000:0.0:1787906726.586289:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000285952 00000100:00100000:0.0:1787906726.586518:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787906726.586534:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000850d09c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+9:5853:x1874756000285952:12345-0@lo:502: 00000100:00100000:0.0:1787906726.587283:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000850d09c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+9:5853:x1874756000285952:12345-0@lo:502: Request processed in 749us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906726.587293:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787906726.587405:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:5853:1874756000285952:0@lo:502: 00000020:01000000:1.0:1787906726.587434:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787906726.587440:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787906726.587441:0:5853:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787906726.587445:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787906726.587676:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787906726.587719:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787906726.587755:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 000000009a94bcd1/0x72bb6cf063cacf8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacf94 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906726.587769:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 000000009a94bcd1/0x72bb6cf063cacf8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacf94 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906726.587780:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8aa51a4db800 from 1 10000000:01000000:0.0:1787906726.587783:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787906726.587848:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906726.587859:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906726.587871:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906726.587896:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005875b6c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286080:0@lo:101: 00000100:00100000:0.0:1787906726.587955:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906726.587998:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f80d45ef going to sleep for 11 seconds 00000100:00100000:3.0:1787906726.588071:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000286080 00000100:00100000:3.0:1787906726.588080:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000286080 00000100:00100000:3.0:1787906726.588131:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787906726.588141:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000777d2024 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+9:5811:x1874756000286080:12345-0@lo:101: 00010000:00010000:3.0:1787906726.588156:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906726.588172:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007d2f5e34/0x72bb6cf063cacfe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cacfe1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.588201:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d2f5e34/0x72bb6cf063cacfe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cacfe1 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.588212:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007d2f5e34/0x72bb6cf063cacfe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cacfe1 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.588231:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007d2f5e34, rc 0) 00000100:00100000:3.0:1787906726.588275:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000777d2024 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+10:5811:x1874756000286080:12345-0@lo:101: Request processed in 137us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906726.588282:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787906726.588312:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005875b6c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286080:0@lo:101: 00010000:00010000:1.0:1787906726.588329:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacfe8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.588339:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cacfe8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906726.589232:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286208:0@lo:256: 00000100:00100000:1.0:1787906726.589288:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906726.589381:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3267f61 going to sleep for 11 seconds 00000100:00100000:0.0:1787906726.589479:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000286208 00000100:00100000:0.0:1787906726.589487:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000286208 00000100:00100000:0.0:1787906726.589532:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787906726.589540:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002eaf260e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+10:5811:x1874756000286208:12345-0@lo:256: 20000000:01000000:0.0:1787906726.589558:0:5823:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787906726.589564:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787906726.589753:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002eaf260e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+10:5811:x1874756000286208:12345-0@lo:256: Request processed in 214us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906726.589762:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787906726.589848:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286208:0@lo:256: 10000000:01000000:1.0:1787906726.590715:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787906726.590852:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacfe8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.590880:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacfe8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787906726.590889:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa51a4db800 from 1 10000000:01000000:1.0:1787906726.590893:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787906726.590932:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.590945:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.590954:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906726.590981:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286336:0@lo:101: 00000100:00100000:1.0:1787906726.591040:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906726.591080:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3267f61 going to sleep for 11 seconds 00000100:00100000:0.0:1787906726.591153:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000286336 00000100:00100000:0.0:1787906726.591168:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000286336 00000100:00100000:0.0:1787906726.591223:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787906726.591230:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be98d887 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+10:5811:x1874756000286336:12345-0@lo:101: 00010000:00010000:0.0:1787906726.591241:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906726.591253:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eb37552b/0x72bb6cf063cacff6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cacfef expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906726.591274:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb37552b/0x72bb6cf063cacff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cacfef expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906726.591283:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eb37552b/0x72bb6cf063cacff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cacfef expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906726.591291:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eb37552b, rc 0) 00000100:00100000:0.0:1787906726.591330:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be98d887 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:5811:x1874756000286336:12345-0@lo:101: Request processed in 101us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906726.591336:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787906726.591360:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286336:0@lo:101: 00010000:00010000:1.0:1787906726.591450:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacff6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.591459:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cacff6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906726.591510:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286464:0@lo:501: 00000100:00100000:1.0:1787906726.591535:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906726.591554:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3267f61 going to sleep for 11 seconds 00000100:00100000:3.0:1787906726.591625:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000286464 00000100:00100000:3.0:1787906726.591630:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000286464 00000100:00100000:3.0:1787906726.591670:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787906726.591676:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfb4e056 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:5811:x1874756000286464:12345-0@lo:501: 00000100:00100000:3.0:1787906726.592538:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfb4e056 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:5811:x1874756000286464:12345-0@lo:501: Request processed in 859us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906726.592552:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787906726.592564:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286464:0@lo:501: 00000100:00100000:1.0:1787906726.592607:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286592:0@lo:503: 00000100:00100000:1.0:1787906726.592646:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906726.592683:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3267f61 going to sleep for 11 seconds 00000100:00100000:2.0:1787906726.592736:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000286592 00000100:00100000:2.0:1787906726.592745:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000286592 00000100:00100000:2.0:1787906726.592786:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787906726.592796:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a77c3ad7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:5811:x1874756000286592:12345-0@lo:503: 00000040:00080000:2.0:1787906726.592863:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787906726.592909:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a77c3ad7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:5811:x1874756000286592:12345-0@lo:503: Request processed in 116us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906726.592922:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787906726.593194:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286592:0@lo:503: 00000040:00080000:2.0:1787906726.594199:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787906726.594280:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787906726.594300:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787906726.594324:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacff6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.594336:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacff6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787906726.594395:0:5811:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787906726.594399:0:5811:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8aa51a4db800 10000000:01000000:1.0:1787906726.594402:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8aa51a4db800 10000000:01000000:1.0:1787906726.594406:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787906726.594411:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8aa51a4db800 from 1 10000000:01000000:1.0:1787906726.594413:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787906726.594447:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000645fc019/0x72bb6cf063cacffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.594455:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000645fc019/0x72bb6cf063cacffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.594464:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000645fc019/0x72bb6cf063cacffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906726.594479:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286720:0@lo:101: 00000100:00100000:1.0:1787906726.594533:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906726.594568:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000738a9a9a going to sleep for 11 seconds 00000100:00100000:3.0:1787906726.594574:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000286720 00000100:00100000:3.0:1787906726.594582:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000286720 00000100:00100000:3.0:1787906726.594628:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787906726.594637:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b57fbf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:5811:x1874756000286720:12345-0@lo:101: 00010000:00010000:3.0:1787906726.594651:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906726.594668:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009037eca7/0x72bb6cf063cad004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cacffd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.594692:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009037eca7/0x72bb6cf063cad004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cacffd expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.594702:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009037eca7/0x72bb6cf063cad004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cacffd expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.594726:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009037eca7, rc 0) 00000100:00100000:3.0:1787906726.594772:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b57fbf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5811:x1874756000286720:12345-0@lo:101: Request processed in 137us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906726.594787:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787906726.594939:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286720:0@lo:101: 00010000:00010000:1.0:1787906726.594955:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000645fc019/0x72bb6cf063cacffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad004 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.594966:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000645fc019/0x72bb6cf063cacffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad004 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906726.595016:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286848:0@lo:501: 00000100:00100000:1.0:1787906726.595041:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906726.595108:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000738a9a9a going to sleep for 11 seconds 00000100:00100000:0.0:1787906726.595143:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000286848 00000100:00100000:0.0:1787906726.595148:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000286848 00000100:00100000:0.0:1787906726.595214:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787906726.595222:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d821bdca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5811:x1874756000286848:12345-0@lo:501: 00000100:00100000:0.0:1787906726.595519:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d821bdca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5811:x1874756000286848:12345-0@lo:501: Request processed in 297us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906726.595526:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787906726.595543:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286848:0@lo:501: 00000100:00100000:1.0:1787906726.595571:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286976:0@lo:503: 00000100:00100000:1.0:1787906726.595613:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906726.595636:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000738a9a9a going to sleep for 11 seconds 00000100:00100000:3.0:1787906726.595683:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000286976 00000100:00100000:3.0:1787906726.595688:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000286976 00000100:00100000:3.0:1787906726.595722:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787906726.595729:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f5f8cc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5811:x1874756000286976:12345-0@lo:503: 00000100:00100000:3.0:1787906726.596219:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f5f8cc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5811:x1874756000286976:12345-0@lo:503: Request processed in 489us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906726.596229:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787906726.596540:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000667f9816 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000286976:0@lo:503: 00000100:00100000:3.0:1787906726.598587:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cdb62736 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:5859:1874756000287104:0@lo:502: 00000100:00100000:3.0:1787906726.598686:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906726.598737:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d06a698e going to sleep for 11 seconds 00000100:00100000:0.0:1787906726.598856:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000287104 00000100:00100000:0.0:1787906726.598864:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000287104 00000100:00100000:0.0:1787906726.598914:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787906726.598922:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000613218e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5859:x1874756000287104:12345-0@lo:502: 00000100:00100000:0.0:1787906726.599274:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000613218e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5859:x1874756000287104:12345-0@lo:502: Request processed in 352us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906726.599288:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787906726.599404:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cdb62736 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:5859:1874756000287104:0@lo:502: 00000020:01000004:1.0:1787906726.599623:0:5859:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787906726.599642:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b6500e73) 00000020:00000080:1.0:1787906726.599667:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787906726.600024:0:5859:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c7afd1ec from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787906726.600030:0:5859:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c7afd1ec from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787906726.600033:0:5859:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c7afd1ec 4 00010000:00080000:1.0:1787906726.600067:0:5859:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003d79f546@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1787906726.602092:0:5859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787906726.603059:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787906726.603112:0:5859:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787906726.603130:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x72bb6cf063cad012 00000100:00080000:0.0:1787906726.603146:0:5859:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787906726.603152:0:5859:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003d79f546 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1787906726.603202:0:5859:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000017a90350 x1874756000287232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787906726.603230:0:5859:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787906726.603262:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017a90350 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874756000287232:0@lo:38: 00000100:00100000:1.0:1787906726.603362:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906726.603450:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000287232 00000100:00100000:1.0:1787906726.603459:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000287232 00000100:00100000:1.0:1787906726.603499:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787906726.603508:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000667f9816 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1874756000287232:12345-0@lo:38: 00000100:00100000:1.0:1787906726.603569:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000667f9816 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1874756000287232:12345-0@lo:38: Request processed in 61us (207us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787906726.603577:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787906726.603622:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787906726.603647:0:3300:0:(import.c:65:import_set_state_nolock()) 000000003d79f546 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787906726.603652:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787906726.603655:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017a90350 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874756000287232:0@lo:38: 00000100:00100000:0.0:1787906726.603676:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a098bcc3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:5859:1874756000287360:0@lo:502: 00000100:00100000:0.0:1787906726.603746:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906726.603778:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f80d45ef going to sleep for 11 seconds 00000100:00100000:2.0:1787906726.603958:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000287360 00000100:00100000:2.0:1787906726.603963:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000287360 00000100:00100000:2.0:1787906726.604004:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787906726.604012:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9215498 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5859:x1874756000287360:12345-0@lo:502: 00000100:00100000:2.0:1787906726.604337:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9215498 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5859:x1874756000287360:12345-0@lo:502: Request processed in 325us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906726.604346:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787906726.604423:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a098bcc3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:5859:1874756000287360:0@lo:502: 00000040:00080000:0.0:1787906726.604448:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787906726.604628:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787906726.604655:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787906726.604716:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000645fc019/0x72bb6cf063cacffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad004 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.604727:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000645fc019/0x72bb6cf063cacffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad004 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787906726.604780:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787906726.604784:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787906726.604786:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787906726.604787:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787906726.604788:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787906726.604790:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787906726.604791:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787906726.604793:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787906726.604794:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787906726.604796:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787906726.604797:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787906726.604799:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787906726.604803:0:5811:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787906726.604806:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787906726.604807:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787906726.604809:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787906726.604947:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787906726.604949:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787906726.604956:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787906726.604957:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787906726.604958:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787906726.604959:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787906726.604960:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787906726.604960:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787906726.604961:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787906726.604984:0:5811:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787906726.604997:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ef90b81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000287488:0@lo:253: 00000100:00100000:1.0:1787906726.605045:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906726.605114:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3267f61 going to sleep for 11 seconds 00000100:00100000:0.0:1787906726.605162:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000287488 00000100:00100000:0.0:1787906726.605168:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000287488 00000100:00100000:0.0:1787906726.605250:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787906726.605260:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a010f69e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5811:x1874756000287488:12345-0@lo:253: 20000000:01000000:0.0:1787906726.605289:0:5824:0:(mgs_handler.c:454:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787906726.605307:0:5824:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787906726.672091:0:5824:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787906726.672129:0:5824:0:(mgs_handler.c:675:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787906726.673889:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787906726.673910:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787906726.673953:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.673980:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007d2f5e34/0x72bb6cf063cacfe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cacfe1 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.673990:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.674070:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007d2f5e34/0x72bb6cf063cacfe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cacfe1 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.674094:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007d2f5e34/0x72bb6cf063cacfe8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cacfe1 expref: 12 pid: 5825 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906726.674115:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f1dfafd6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1874756000287616:0@lo:104: 00000100:00100000:1.0:1787906726.674207:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906726.674297:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9f4947a going to sleep for 11 seconds 00000100:00100000:3.0:1787906726.674396:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000287616 00000100:00100000:3.0:1787906726.674409:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000287616 00000100:00100000:3.0:1787906726.674483:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787906726.674494:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5eda065 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:5846:x1874756000287616:12345-0@lo:104: 00010000:00010000:3.0:1787906726.674510:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cacfe8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.674578:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787906726.674583:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5eda065 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:5846:x1874756000287616:12345-0@lo:104: Request processed in 92us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906726.674592:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787906726.674768:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f1dfafd6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1874756000287616:0@lo:104: 00010000:00010000:1.0:1787906726.674792:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.674936:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787906726.674943:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cacfe8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.674951:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004e5b0d87 already unused, calling callback (00000000a041aa3e) 10000000:00010000:3.0:1787906726.674962:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cacfe8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.674970:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cacfe8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906726.674977:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cacfe8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906726.674984:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787906726.675023:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cacfe8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.675030:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906726.675045:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cacfe8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.675051:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: 000000004e5b0d87/0x72bb6cf063cacfe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cacfe8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.675070:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906726.675073:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906726.675074:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906726.676020:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035cb8e4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000287744:0@lo:103: 00000100:00100000:0.0:1787906726.676086:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906726.676455:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000287744 00000100:00100000:3.0:1787906726.676464:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000287744 00010000:00010000:3.0:1787906726.676493:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007d2f5e34/0x72bb6cf063cacfe8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cacfe1 expref: 13 pid: 5825 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906726.676527:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787906726.676535:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a098bcc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:3302:x1874756000287744:12345-0@lo:103: 00010000:00010000:3.0:1787906726.676553:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906726.676565:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007d2f5e34/0x72bb6cf063cacfe8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cacfe1 expref: 13 pid: 5825 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.676577:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007d2f5e34/0x72bb6cf063cacfe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cacfe1 expref: 13 pid: 5825 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.676595:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007d2f5e34/0x72bb6cf063cacfe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cacfe1 expref: 13 pid: 5825 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.676612:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.676621:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787906726.676639:0:5815:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002730906s 00010000:00010000:3.0:1787906726.676643:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.676650:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.676656:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.676663:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.676669:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dcf44095 already unused, calling callback (00000000c6a0f0dc) 00010000:00010000:3.0:1787906726.676674:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.676680:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.676701:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906726.676724:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906726.676779:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a098bcc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3302:x1874756000287744:12345-0@lo:103: Request processed in 246us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906726.676787:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787906726.676915:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035cb8e4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000287744:0@lo:103: 00010000:00010000:1.0:1787906726.677368:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.677380:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906726.677386:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dcf44095/0x72bb6cf063cad019 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906726.699950:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a010f69e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:5811:x1874756000287488:12345-0@lo:253: Request processed in 94683us (94894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906726.699966:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787906726.700094:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ef90b81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:5811:1874756000287488:0@lo:253: 10000000:01000000:1.0:1787906726.700112:0:5811:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787906726.700115:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787906726.700117:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787906726.700119:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787906726.700120:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787906726.700122:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787906726.700123:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787906726.700124:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787906726.700125:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787906726.700127:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787906726.700128:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787906726.700129:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787906726.700130:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787906726.700149:0:5811:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787906726.710103:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787906726.710517:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787906726.710789:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787906726.711025:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787906726.711228:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787906726.711423:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787906726.721307:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787906726.721538:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787906726.721777:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787906726.724155:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787906726.724521:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787906726.724698:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1787906726.809267:0:5811:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787906726.909158:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787906726.909803:0:5865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787906726.913276:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787906726.913688:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787906726.913936:0:5864:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787906726.913943:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:1.0:1787906726.914955:0:5811:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787906726.914970:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787906726.915248:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787906726.917070:0:5811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787906726.917779:0:5811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787906726.917854:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787906726.918169:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787906726.919313:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787906726.924470:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787906726.924649:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787906726.924808:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787906726.925071:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787906726.927519:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787906726.927862:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787906726.928043:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787906726.928223:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787906726.929540:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787906726.929797:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787906726.929979:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787906726.930154:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787906726.931107:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787906726.931314:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787906726.931491:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787906726.931651:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787906726.935562:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787906726.939463:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787906726.939752:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787906726.939948:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787906726.943668:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787906726.943924:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787906726.944908:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787906726.945076:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787906726.945222:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787906726.945658:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787906726.945855:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787906726.946030:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787906726.946170:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787906726.946367:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787906726.946520:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787906726.946664:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787906726.946903:0:5811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787906726.989782:0:5865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787906727.072931:0:5811:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787906727.072986:0:5811:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb866c1daf988 00100000:10000000:2.0:1787906727.072998:0:5811:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787906727.077342:0:5811:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787906727.077364:0:5811:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787906727.077504:0:5811:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787906727.077546:0:5811:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787906727.134675:0:5865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787906727.134775:0:5865:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1787906727.134781:0:5865:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787906727.584913:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906728.608922:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906729.636433:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906730.656009:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906731.687841:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787906731.689177:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787906731.689185:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8aa51a4db800 from 3 10000000:01000000:0.0:1787906731.689190:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787906731.689241:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000cb8025be/0x72bb6cf063cad020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906731.689254:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000cb8025be/0x72bb6cf063cad020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906731.689266:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000cb8025be/0x72bb6cf063cad020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906731.689295:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055262d58 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000287872:0@lo:101: 00000100:00100000:0.0:1787906731.689380:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906731.689438:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000005804f648 going to sleep for 11 seconds 00000100:00100000:0.0:1787906731.689466:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000287872 00000100:00100000:0.0:1787906731.689474:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000287872 00000100:00100000:0.0:1787906731.689528:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787906731.689537:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7e91d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:5827:x1874756000287872:12345-0@lo:101: 00010000:00010000:0.0:1787906731.689551:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906731.689563:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003d11b837/0x72bb6cf063cad027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad020 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906731.689604:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d11b837/0x72bb6cf063cad027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad020 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906731.689624:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003d11b837/0x72bb6cf063cad027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad020 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906731.689634:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003d11b837, rc 0) 00000100:00100000:0.0:1787906731.689673:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7e91d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5827:x1874756000287872:12345-0@lo:101: Request processed in 137us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906731.689680:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787906731.689729:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055262d58 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000287872:0@lo:101: 00010000:00010000:0.0:1787906731.689742:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000cb8025be/0x72bb6cf063cad020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad027 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906731.689750:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000cb8025be/0x72bb6cf063cad020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad027 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906731.689795:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055262d58 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000288000:0@lo:256: 00000100:00100000:0.0:1787906731.689853:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906731.689869:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000005804f648 going to sleep for 11 seconds 00000100:00100000:0.0:1787906731.689882:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000288000 00000100:00100000:0.0:1787906731.689886:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000288000 00000100:00100000:0.0:1787906731.689923:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787906731.689930:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0dd33b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5827:x1874756000288000:12345-0@lo:256: 20000000:01000000:0.0:1787906731.689946:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787906731.689964:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787906731.689967:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787906731.690067:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0dd33b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5827:x1874756000288000:12345-0@lo:256: Request processed in 138us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906731.690073:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787906731.690102:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055262d58 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000288000:0@lo:256: 10000000:01000000:0.0:1787906731.690140:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787906731.690145:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000cb8025be/0x72bb6cf063cad020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad027 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906731.690152:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000cb8025be/0x72bb6cf063cad020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad027 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787906731.694489:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787906731.694500:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787906731.694503:0:8:0:(import.c:65:import_set_state_nolock()) 000000003d79f546 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787906731.694515:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003d79f546 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1787906731.694553:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000055262d58 x1874756000288128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787906731.694620:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055262d58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874756000288128:0@lo:38: 00000100:00100000:0.0:1787906731.694691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906731.694924:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000288128 00000100:00100000:2.0:1787906731.694932:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000288128 00000100:00100000:2.0:1787906731.694963:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787906731.694970:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072bdaed4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3300:x1874756000288128:12345-0@lo:38: 00010000:00080000:2.0:1787906731.696841:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:2.0:1787906731.696888:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x72bb6cf063cad02e 00000004:00100000:2.0:1787906731.696941:0:5832:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787906731.697465:0:5832:0:(import.c:65:import_set_state_nolock()) 000000006cc6d9f5 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787906731.697574:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072bdaed4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874756000288128:12345-0@lo:38: Request processed in 2602us (2882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906731.697585:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787906731.701034:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000055262d58 x1874756000288128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787906741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787906731.701061:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787906731.701071:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787906731.702004:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787906731.702011:0:3300:0:(import.c:65:import_set_state_nolock()) 000000003d79f546 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787906731.702022:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055262d58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874756000288128:0@lo:38: 00010000:00010000:3.0:1787906732.704250:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787906733.067118:0:6106:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787906733.727933:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906734.751954:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906735.776053:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906736.799989:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906736.805016:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ef90b81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000288256:0@lo:400: 00000100:00100000:3.0:1787906736.805136:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906736.805216:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787906736.805223:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f1dfafd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000288384:0@lo:400: 00000100:00100000:3.0:1787906736.805284:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906736.805353:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000288384 00000100:00100000:3.0:1787906736.805364:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000288384 00000100:00100000:3.0:1787906736.805426:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787906736.805437:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033d3dd01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000288384:12345-0@lo:400: 00000100:00100000:3.0:1787906736.805763:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033d3dd01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000288384:12345-0@lo:400: Request processed in 327us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906736.805772:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787906736.805853:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f1dfafd6 x1874756000288384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906736.805870:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f1dfafd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000288384:0@lo:400: 00000100:00100000:1.0:1787906736.810099:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000288256 00000100:00100000:1.0:1787906736.810126:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000288256 00000100:00100000:1.0:1787906736.810228:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787906736.810240:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f455dba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3303:x1874756000288256:12345-0@lo:400: 00000100:00100000:1.0:1787906736.810392:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f455dba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3303:x1874756000288256:12345-0@lo:400: Request processed in 153us (5256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906736.810401:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787906736.810775:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ef90b81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000288256:0@lo:400: 00010000:00010000:3.0:1787906737.824674:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906738.850943:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787906739.288220:0:6309:0:(class_obd.c:354:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb3c032d0 20000000:00000080:0.0:1787906739.288270:0:6309:0:(mgs_handler.c:1205:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8aa541c64000 uarg=0000000000000000 20000000:01000000:0.0:1787906739.288336:0:6309:0:(mgs_llog.c:6200:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787906739.288346:0:6309:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787906739.288354:0:6309:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787906739.291171:0:6309:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787906739.291203:0:6309:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787906739.300357:0:6309:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787906739.301356:0:6309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787906739.301446:0:6309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787906739.301515:0:6309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787906739.301550:0:6309:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787906739.301580:0:6309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906739.301607:0:6309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000eb37552b/0x72bb6cf063cacff6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cacfef expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906739.301616:0:6309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906739.301674:0:6309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000eb37552b/0x72bb6cf063cacff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cacfef expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906739.301697:0:6309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000eb37552b/0x72bb6cf063cacff6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cacfef expref: 11 pid: 5824 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906739.301728:0:6309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e7c45715 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6309:1874756000288512:0@lo:104: 00000100:00100000:1.0:1787906739.303606:0:6309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906739.303757:0:6309:0:(client.c:2715:ptlrpc_set_wait()) set 00000000332e1c41 going to sleep for 11 seconds 00000100:00100000:0.0:1787906739.309529:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000288512 00000100:00100000:0.0:1787906739.309572:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000288512 00000100:00100000:0.0:1787906739.309658:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787906739.309670:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b631038a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:6309:x1874756000288512:12345-0@lo:104: 00010000:00010000:0.0:1787906739.309699:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cacff6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906739.309869:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787906739.309875:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b631038a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:6309:x1874756000288512:12345-0@lo:104: Request processed in 207us (6281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906739.309882:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787906739.310089:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787906739.310099:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cacff6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906739.310109:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000316c412f already unused, calling callback (00000000a041aa3e) 10000000:00010000:2.0:1787906739.310113:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cacff6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906739.310151:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cacff6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787906739.310159:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cacff6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906739.310166:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787906739.310231:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cacff6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906739.310239:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787906739.310280:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cacff6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906739.310289:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: 00000000316c412f/0x72bb6cf063cacfef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cacff6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906739.310316:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906739.310318:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906739.310320:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906739.310332:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787906739.310352:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027e808ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000288640:0@lo:103: 00000100:00100000:2.0:1787906739.310422:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906739.310649:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000288640 00000100:00100000:3.0:1787906739.310660:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000288640 00010000:00010000:3.0:1787906739.310696:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000eb37552b/0x72bb6cf063cacff6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cacfef expref: 12 pid: 5824 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906739.310729:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787906739.310735:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bda0c86 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3302:x1874756000288640:12345-0@lo:103: 00010000:00010000:3.0:1787906739.310748:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906739.310753:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000eb37552b/0x72bb6cf063cacff6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cacfef expref: 12 pid: 5824 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906739.310764:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000eb37552b/0x72bb6cf063cacff6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cacfef expref: 12 pid: 5824 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906739.310797:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906739.310806:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906739.310850:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906739.310857:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906739.310864:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906739.310870:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906739.310875:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005daab87e already unused, calling callback (00000000c6a0f0dc) 00010000:00010000:3.0:1787906739.310879:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906739.310886:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906739.310894:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906739.310904:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906739.310943:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bda0c86 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3302:x1874756000288640:12345-0@lo:103: Request processed in 208us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906739.310958:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787906739.311014:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027e808ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000288640:0@lo:103: 00010000:00010000:1.0:1787906739.311360:0:6309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eb37552b/0x72bb6cf063cacff6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cacfef expref: 11 pid: 5824 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906739.311380:0:6309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e7c45715 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6309:1874756000288512:0@lo:104: 00010000:00010000:1.0:1787906739.311403:0:6309:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906739.311414:0:6309:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906739.311419:0:6309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906739.311426:0:6309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005daab87e/0x72bb6cf063cad035 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906739.872072:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787906740.840840:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787906740.840849:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa51a4db800 from 1 10000000:01000000:2.0:1787906740.840853:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787906740.840912:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000dd724e15/0x72bb6cf063cad03c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906740.840926:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000dd724e15/0x72bb6cf063cad03c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906740.840958:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000dd724e15/0x72bb6cf063cad03c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906740.840985:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059af6f78 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000288768:0@lo:101: 00000100:00100000:2.0:1787906740.841067:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906740.841118:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f09fafe7 going to sleep for 11 seconds 00000100:00100000:0.0:1787906740.841855:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000288768 00000100:00100000:0.0:1787906740.841865:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000288768 00000100:00100000:0.0:1787906740.841933:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787906740.841943:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cd1331f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:5827:x1874756000288768:12345-0@lo:101: 00010000:00010000:0.0:1787906740.841965:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906740.841979:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009de80213/0x72bb6cf063cad043 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad03c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906740.842000:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009de80213/0x72bb6cf063cad043 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad03c expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906740.842032:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009de80213/0x72bb6cf063cad043 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad03c expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906740.842041:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009de80213, rc 0) 00000100:00100000:0.0:1787906740.842095:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cd1331f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5827:x1874756000288768:12345-0@lo:101: Request processed in 154us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906740.842101:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787906740.842150:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059af6f78 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000288768:0@lo:101: 00010000:00010000:0.0:1787906740.842165:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000dd724e15/0x72bb6cf063cad03c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad043 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906740.842173:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000dd724e15/0x72bb6cf063cad03c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad043 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906740.842232:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055262d58 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000288896:0@lo:501: 00000100:00100000:0.0:1787906740.842258:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906740.842274:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a65235c9 going to sleep for 11 seconds 00000100:00100000:0.0:1787906740.842286:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000288896 00000100:00100000:0.0:1787906740.842289:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000288896 00000100:00100000:0.0:1787906740.842307:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787906740.842313:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2a5aee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5827:x1874756000288896:12345-0@lo:501: 00000100:00100000:0.0:1787906740.842581:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2a5aee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5827:x1874756000288896:12345-0@lo:501: Request processed in 267us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906740.842588:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787906740.842619:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055262d58 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000288896:0@lo:501: 00000100:00100000:0.0:1787906740.842643:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055262d58 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000289024:0@lo:503: 00000100:00100000:0.0:1787906740.842682:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906740.842695:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a65235c9 going to sleep for 11 seconds 00000100:00100000:0.0:1787906740.842705:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000289024 00000100:00100000:0.0:1787906740.842709:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000289024 00000100:00100000:0.0:1787906740.842743:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787906740.842749:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069c8362c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5827:x1874756000289024:12345-0@lo:503: 00000100:00100000:0.0:1787906740.842893:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069c8362c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5827:x1874756000289024:12345-0@lo:503: Request processed in 144us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906740.842900:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787906740.842936:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055262d58 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000289024:0@lo:503: 00000100:00100000:3.0:1787906740.847865:0:6334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038862dbe pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:6334:1874756000289152:0@lo:502: 00000100:00100000:3.0:1787906740.848291:0:6334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906740.848343:0:6334:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a78894a6 going to sleep for 11 seconds 00000100:00100000:1.0:1787906740.848457:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000289152 00000100:00100000:1.0:1787906740.848474:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000289152 00000100:00100000:1.0:1787906740.848531:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787906740.848539:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069fd630c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6334:x1874756000289152:12345-0@lo:502: 00000100:00100000:1.0:1787906740.848747:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069fd630c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6334:x1874756000289152:12345-0@lo:502: Request processed in 208us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906740.848755:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787906740.853213:0:6334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038862dbe pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:6334:1874756000289152:0@lo:502: 00000020:01000000:3.0:1787906740.853262:0:6334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787906740.853272:0:6334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787906740.853275:0:6334:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787906740.853286:0:6334:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa51a4db800 00000020:00000080:3.0:1787906740.853288:0:6334:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787906740.853345:0:6334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503050e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:6334:1874756000289280:0@lo:502: 00000100:00100000:3.0:1787906740.853455:0:6334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906740.853513:0:6334:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5073f8540 going to sleep for 11 seconds 00000100:00100000:2.0:1787906740.853607:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000289280 00000100:00100000:2.0:1787906740.853617:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000289280 00000100:00100000:2.0:1787906740.853687:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787906740.853698:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6334:x1874756000289280:12345-0@lo:502: 00000100:00100000:2.0:1787906740.853974:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6334:x1874756000289280:12345-0@lo:502: Request processed in 277us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906740.853982:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787906740.856544:0:6334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503050e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:6334:1874756000289280:0@lo:502: 00000020:01000000:3.0:1787906740.856589:0:6334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787906740.856598:0:6334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787906740.856601:0:6334:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787906740.856608:0:6334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787906740.856920:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787906740.856942:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787906740.856964:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa5421faa00/0x72bb6cf063cad03c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad043 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906740.856976:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa5421faa00/0x72bb6cf063cad03c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad043 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906740.899262:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906741.922690:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906741.923072:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787906741.923095:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000289408:0@lo:400: 00000100:00100000:2.0:1787906741.923167:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906741.923363:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000289408 00000100:00100000:0.0:1787906741.923370:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000289408 00000100:00100000:0.0:1787906741.923428:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787906741.923448:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3301:x1874756000289408:12345-0@lo:400: 00000100:00100000:0.0:1787906741.923505:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3301:x1874756000289408:12345-0@lo:400: Request processed in 68us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906741.923513:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787906741.923558:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000289408:0@lo:400: 00000100:00100000:3.0:1787906741.923669:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000289536:0@lo:400: 00000100:00100000:3.0:1787906741.923699:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906741.925210:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000289536 00000100:00100000:0.0:1787906741.925222:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000289536 00000100:00100000:0.0:1787906741.925266:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787906741.925275:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000289536:12345-0@lo:400: 00000100:00100000:0.0:1787906741.925340:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000289536:12345-0@lo:400: Request processed in 66us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906741.925347:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787906741.925801:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8aa510328e00 x1874756000289536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906741.925834:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000289536:0@lo:400: 00010000:00010000:2.0:1787906742.945668:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906743.969997:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906744.992455:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906746.016037:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906747.040761:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000289792:0@lo:400: 00000100:00100000:2.0:1787906747.040919:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906747.041020:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000289792 00000100:00100000:2.0:1787906747.041028:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000289792 00000100:00100000:2.0:1787906747.041075:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787906747.041084:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000289792:12345-0@lo:400: 00000100:00100000:2.0:1787906747.041146:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000289792:12345-0@lo:400: Request processed in 63us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906747.041153:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787906747.041956:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787906747.041977:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000289664:0@lo:400: 00000100:00100000:1.0:1787906747.042060:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906747.042134:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000289664 00000100:00100000:1.0:1787906747.042144:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000289664 00000100:00100000:1.0:1787906747.042209:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787906747.042218:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3303:x1874756000289664:12345-0@lo:400: 00000100:00100000:1.0:1787906747.042265:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3303:x1874756000289664:12345-0@lo:400: Request processed in 49us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906747.042273:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787906747.042348:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000289664:0@lo:400: 00010000:00080000:1.0:1787906747.042449:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8aa541c1f800 x1874756000289792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906747.042465:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000289792:0@lo:400: 00010000:00010000:0.0:1787906747.043462:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906748.067764:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787906748.294299:0:6670:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787906748.294305:0:6670:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787906748.294754:0:6670:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8aa510341800 00000020:01000004:1.0:1787906748.294778:0:6670:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787906748.294791:0:6670:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787906748.294806:0:6670:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8aa503118000) 00000020:00000080:1.0:1787906748.294846:0:6670:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787906748.363333:0:6670:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787906748.363612:0:6670:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787906748.434585:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787906748.455038:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787906748.455071:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787906748.455119:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787906748.455140:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787906748.455486:0:6670:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787906748.455497:0:6670:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787906748.455508:0:6670:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72bb6cf063cad051 00000020:01000004:2.0:1787906748.455517:0:6670:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787906748.455540:0:6670:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787906748.455543:0:6670:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787906748.455549:0:6670:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787906748.455552:0:6670:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787906748.455570:0:6670:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8aa52ebc19b8) 00000020:00000080:2.0:1787906748.455585:0:6670:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787906748.472986:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787906748.473193:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787906748.473199:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787906748.480616:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787906748.480629:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787906748.482113:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787906748.482125:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787906748.485239:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787906748.485771:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787906748.485779:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787906748.487059:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787906748.487069:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787906748.529794:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787906748.530211:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787906748.530219:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787906748.548064:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787906748.548086:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787906748.555499:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787906748.555519:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787906748.572408:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787906748.575380:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787906748.575387:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787906748.582072:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787906748.582085:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787906748.718870:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787906748.719137:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787906748.719143:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787906748.731002:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787906748.731031:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787906748.733884:0:6670:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787906748.733978:0:6670:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787906748.733986:0:6670:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787906748.806332:0:6670:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787906748.806381:0:6670:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787906748.806385:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787906748.806387:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787906748.806388:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787906748.806389:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787906748.806390:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787906748.806391:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787906748.806393:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787906748.806394:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787906748.806395:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787906748.806397:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787906748.806398:0:6670:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787906748.806401:0:6670:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787906748.806403:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787906748.806405:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787906748.806406:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787906748.806407:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787906748.806408:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787906748.806425:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787906748.806426:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787906748.806427:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787906748.806428:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787906748.806429:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787906748.806430:0:6670:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787906748.806461:0:6670:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787906748.806487:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000289920:0@lo:253: 00000100:00100000:2.0:1787906748.806569:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906748.807107:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000289920 00000100:00100000:1.0:1787906748.807115:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000289920 00000100:00100000:2.0:1787906748.807407:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161900 going to sleep for 11 seconds 00000100:00100000:1.0:1787906748.807547:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787906748.807571:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6670:x1874756000289920:12345-0@lo:253: 20000000:01000000:1.0:1787906748.807649:0:5823:0:(mgs_handler.c:480:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787906748.807655:0:5823:0:(mgs_handler.c:538:mgs_target_reg()) Checking nodemap for target registration lustre-OST0000 20000000:01000000:1.0:1787906748.807658:0:5823:0:(mgs_handler.c:544:mgs_target_reg()) lustre-OST0000: Nodemap subsystem disabled, allowing target registration 20000000:01000000:1.0:1787906748.807661:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787906748.807674:0:5823:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787906748.807677:0:5823:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787906748.810699:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787906748.813386:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787906748.813436:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787906748.813510:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787906748.813519:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787906748.813550:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787906748.813626:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787906748.821673:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787906748.821948:0:5823:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.120@tcp 20000000:01000000:1.0:1787906748.821951:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:1.0:1787906748.821996:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787906748.822005:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787906748.822060:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787906748.822067:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:1.0:1787906748.822095:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787906748.822103:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787906748.822126:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787906748.822196:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787906748.824644:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787906748.824702:0:5823:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.120@tcp 20000000:01000000:1.0:1787906748.824704:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:2.0:1787906748.826168:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787906748.826198:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787906748.826241:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787906748.826250:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:2.0:1787906748.826392:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787906748.826405:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787906748.826441:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1787906748.826480:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1787906748.826509:0:5823:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1787906748.826513:0:5823:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1787906748.826523:0:5823:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787906748.826524:0:5823:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787906748.826527:0:5823:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787906748.826547:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787906748.826549:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787906748.826610:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787906748.826613:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787906748.829797:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787906748.830153:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787906748.830206:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787906748.830304:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1787906748.830321:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787906748.830324:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787906748.833781:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1787906748.833935:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1787906748.833998:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787906748.834598:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787906748.834646:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787906748.834714:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787906748.834728:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787906748.834731:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787906748.849342:0:6687:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787906748.849465:0:6687:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787906748.849518:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787906748.854354:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787906748.854487:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787906748.854528:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:3.0:1787906748.854550:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787906748.854733:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.854760:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cacf78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cacf71 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.854768:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa511994800/0x72bb6cf063cacf94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cacf8d expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.854774:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cacffd expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.854805:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.855087:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cacffd expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.855103:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cacffd expref: 12 pid: 5825 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906748.855120:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5823:1874756000290048:0@lo:104: 00000100:00100000:3.0:1787906748.855193:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787906748.855329:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa511994800/0x72bb6cf063cacf94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cacf8d expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.855338:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa511994800/0x72bb6cf063cacf94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cacf8d expref: 12 pid: 5824 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906748.855347:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503050380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5823:1874756000290176:0@lo:104: 00000100:00100000:3.0:1787906748.855371:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787906748.855675:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cacf78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cacf71 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.855685:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cacf78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cacf71 expref: 12 pid: 5824 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906748.855693:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503053800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5823:1874756000290304:0@lo:104: 00000100:00100000:3.0:1787906748.855715:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906748.856067:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000290048 00000100:00100000:0.0:1787906748.856077:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000290048 00000100:00100000:1.0:1787906748.856155:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000290176 00000100:00100000:1.0:1787906748.856159:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000290176 00000100:00100000:1.0:1787906748.856185:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787906748.856211:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503052680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:5823:x1874756000290048:12345-0@lo:104: 00010000:00010000:1.0:1787906748.856228:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cacffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad004 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906748.856340:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787906748.856346:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503052680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:5823:x1874756000290048:12345-0@lo:104: Request processed in 139us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906748.856353:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787906748.856374:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787906748.856379:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503053b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:5823:x1874756000290176:12345-0@lo:104: 00010000:00010000:1.0:1787906748.856387:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cacf8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cacf94 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906748.856685:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5083b2300 going to sleep for 11 seconds 00000100:00100000:3.0:1787906748.856708:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5823:1874756000290048:0@lo:104: 00000100:00100000:3.0:1787906748.856726:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503050380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5823:1874756000290176:0@lo:104: 00000100:00100000:0.0:1787906748.856871:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1787906748.856878:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1787906748.857526:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000290304 00000100:00100000:3.0:1787906748.857534:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000290304 00000100:00100000:0.0:1787906748.857791:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787906748.857800:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503050a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:5823:x1874756000290304:12345-0@lo:104: 00010000:00010000:0.0:1787906748.857850:0:6688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cacf71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cacf78 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906748.858138:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503053800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5823:1874756000290304:0@lo:104: 00010000:00010000:3.0:1787906748.858167:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858242:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787906748.858250:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cacffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad004 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858258:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa542175a00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:2.0:1787906748.858290:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cacffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad004 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858299:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cacffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad004 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787906748.858306:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cacffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad004 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906748.858312:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787906748.858348:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cacffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad004 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858354:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787906748.858376:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cacffd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad004 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858384:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cacffd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad004 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858397:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787906748.858400:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cacf8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cacf94 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858405:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030c00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:2.0:1787906748.858408:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cacf8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cacf94 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858428:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cacf8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cacf94 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787906748.858445:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cacf8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cacf94 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906748.858451:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787906748.858465:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cacf8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cacf94 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858471:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787906748.858485:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cacf8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cacf94 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858491:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cacf8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cacf94 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858501:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787906748.858503:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cacf71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cacf78 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858509:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030000 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:2.0:1787906748.858511:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cacf71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cacf78 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858518:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cacf71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cacf78 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787906748.858524:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cacf71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cacf78 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906748.858529:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787906748.858547:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cacf71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cacf78 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858553:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787906748.858568:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cacf71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cacf78 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858575:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cacf71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cacf78 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906748.858589:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906748.858591:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906748.858592:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906748.858608:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000290432:0@lo:103: 00000100:00100000:2.0:1787906748.858868:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906748.859090:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000290688:0@lo:103: 00000100:00100000:3.0:1787906748.859117:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906748.859147:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787906748.859154:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000290560:0@lo:103: 00000100:00100000:3.0:1787906748.859172:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906748.859206:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000290432 00000100:00100000:3.0:1787906748.859213:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000290432 00010000:00010000:3.0:1787906748.859238:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cacffd expref: 13 pid: 5825 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906748.859258:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000290688 00000100:00100000:3.0:1787906748.859261:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000290688 00010000:00010000:3.0:1787906748.859292:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cacf78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cacf71 expref: 14 pid: 5824 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906748.859303:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000290560 00000100:00100000:3.0:1787906748.859305:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000290560 00010000:00010000:3.0:1787906748.859316:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa511994800/0x72bb6cf063cacf94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cacf8d expref: 15 pid: 5824 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906748.859327:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787906748.859336:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:3302:x1874756000290432:12345-0@lo:103: 00010000:00010000:3.0:1787906748.859360:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906748.859367:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cacffd expref: 15 pid: 5825 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.859380:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cacffd expref: 15 pid: 5825 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.859394:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cacffd expref: 15 pid: 5825 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.859407:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906748.859454:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:3302:x1874756000290432:12345-0@lo:103: Request processed in 119us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906748.859461:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787906748.859477:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787906748.859483:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503053800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:3304:x1874756000290688:12345-0@lo:103: 00010000:00010000:3.0:1787906748.859491:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906748.859495:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cacf78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cacf71 expref: 13 pid: 5824 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.859503:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cacf78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cacf71 expref: 13 pid: 5824 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.859512:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cacf78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cacf71 expref: 13 pid: 5824 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.859521:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906748.859545:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503053800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3304:x1874756000290688:12345-0@lo:103: Request processed in 62us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906748.859550:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787906748.859891:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787906748.859898:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503050380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:3304:x1874756000290560:12345-0@lo:103: 00010000:00010000:3.0:1787906748.859905:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906748.859923:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa511994800/0x72bb6cf063cacf94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cacf8d expref: 11 pid: 5824 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.859931:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa511994800/0x72bb6cf063cacf94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cacf8d expref: 11 pid: 5824 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.859940:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511994800/0x72bb6cf063cacf94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cacf8d expref: 11 pid: 5824 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.859952:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.859959:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.860048:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.860056:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.860063:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.860070:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.860075:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511994400 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787906748.860079:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.860093:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.860108:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.860119:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906748.860147:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503050380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+10:3304:x1874756000290560:12345-0@lo:103: Request processed in 249us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906748.860153:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787906748.860212:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000290560:0@lo:103: 00000100:00100000:3.0:1787906748.860221:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000290688:0@lo:103: 00000100:00100000:3.0:1787906748.860254:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000290432:0@lo:103: 00010000:00010000:3.0:1787906748.860289:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.860298:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906748.860304:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad05f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787906748.860316:0:5823:0:(mgs_handler.c:675:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1787906748.860615:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787906748.860624:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503053b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:5823:x1874756000290176:12345-0@lo:104: Request processed in 4244us (5250us total) trans 0 rc 0/0 00010000:00010000:0.0:1787906748.871432:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787906748.871462:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503050a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:5823:x1874756000290304:12345-0@lo:104: Request processed in 13652us (15734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906748.871478:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787906748.872198:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906748.872509:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787906748.872788:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906749.014635:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+9:6670:x1874756000289920:12345-0@lo:253: Request processed in 207068us (208056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906749.014651:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787906749.014948:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000289920:0@lo:253: 10000000:01000000:2.0:1787906749.014964:0:6670:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787906749.014968:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787906749.014969:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787906749.014971:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787906749.014972:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787906749.014973:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787906749.014974:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787906749.014976:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787906749.014977:0:6670:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787906749.014978:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787906749.014979:0:6670:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787906749.015001:0:6670:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8aa510341800 from lustre-OST0000 10000000:01000000:2.0:1787906749.015054:0:6670:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787906749.015058:0:6670:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787906749.015067:0:6670:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8aa510bd0000 local copy 10000000:01000000:2.0:1787906749.015071:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787906749.015116:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.015127:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.015137:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906749.015155:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000290816:0@lo:101: 00000100:00100000:2.0:1787906749.015188:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906749.015292:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161300 going to sleep for 11 seconds 00000100:00100000:1.0:1787906749.020163:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000290816 00000100:00100000:1.0:1787906749.020182:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000290816 00000100:00100000:1.0:1787906749.020286:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787906749.020299:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+9:6670:x1874756000290816:12345-0@lo:101: 00010000:00010000:1.0:1787906749.020318:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906749.020340:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa542174400/0x72bb6cf063cad06d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad066 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.020368:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa542174400/0x72bb6cf063cad06d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad066 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.020379:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa542174400/0x72bb6cf063cad06d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad066 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.020404:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa542174400, rc 0) 00000100:00100000:1.0:1787906749.020493:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+10:6670:x1874756000290816:12345-0@lo:101: Request processed in 197us (5304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906749.020500:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787906749.021228:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000290816:0@lo:101: 00010000:00010000:2.0:1787906749.021257:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x72bb6cf063cad06d expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.021268:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72bb6cf063cad06d expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906749.021442:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000290944:0@lo:501: 00000100:00100000:2.0:1787906749.021491:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906749.021548:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161300 going to sleep for 11 seconds 00000100:00100000:0.0:1787906749.021836:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000290944 00000100:00100000:0.0:1787906749.021843:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000290944 00000100:00100000:0.0:1787906749.021884:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787906749.021892:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+10:6670:x1874756000290944:12345-0@lo:501: 00000100:00100000:0.0:1787906749.022180:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+10:6670:x1874756000290944:12345-0@lo:501: Request processed in 288us (688us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787906749.022188:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787906749.023121:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000290944:0@lo:501: 10000000:01000000:2.0:1787906749.023155:0:6670:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787906749.023208:0:6670:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787906749.023216:0:6670:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72bb6cf063cad06d expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.023230:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72bb6cf063cad06d expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.023251:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72bb6cf063cad06d expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.023285:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787906749.023309:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8aa510341800 10000000:01000000:2.0:1787906749.023315:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787906749.023320:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8aa510bd0000 10000000:01000000:2.0:1787906749.023324:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787906749.023327:0:6670:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8aa510bd0000 from 1 10000000:01000000:2.0:1787906749.023331:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787906749.023361:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa5421fba00/0x72bb6cf063cad074 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.023369:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa5421fba00/0x72bb6cf063cad074 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.023378:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa5421fba00/0x72bb6cf063cad074 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906749.023394:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000291072:0@lo:101: 00000100:00100000:2.0:1787906749.023439:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906749.023476:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787906749.023547:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000291072 00000100:00100000:3.0:1787906749.023562:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000291072 00000100:00100000:3.0:1787906749.023698:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787906749.023708:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+10:6670:x1874756000291072:12345-0@lo:101: 00010000:00010000:3.0:1787906749.023729:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906749.023742:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad07b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad074 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906749.023764:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad07b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad074 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906749.023774:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad07b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad074 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906749.023784:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511994400, rc 0) 00000100:00100000:3.0:1787906749.023853:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:6670:x1874756000291072:12345-0@lo:101: Request processed in 147us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906749.023860:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1787906749.023938:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787906749.023949:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x72bb6cf063cad06d expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906749.023958:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fa600 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:0.0:1787906749.023961:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x72bb6cf063cad06d expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906749.023970:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x72bb6cf063cad06d expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787906749.023978:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x72bb6cf063cad06d expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906749.023985:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787906749.024012:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bb6cf063cad06d expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906749.024019:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787906749.024045:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bb6cf063cad06d expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906749.024054:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa5421fa600/0x72bb6cf063cad066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bb6cf063cad06d expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906749.024076:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906749.024077:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906749.024088:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906749.024104:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000291200:0@lo:103: 00000100:00100000:0.0:1787906749.024143:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906749.024204:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000291200 00000100:00100000:0.0:1787906749.024208:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000291200 00000100:00100000:0.0:1787906749.024239:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787906749.024245:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510329f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:3301:x1874756000291200:12345-0@lo:103: 00010000:00010000:0.0:1787906749.024255:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906749.024268:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa542174400/0x72bb6cf063cad06d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cad066 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906749.024291:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906749.024319:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510329f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+10:3301:x1874756000291200:12345-0@lo:103: Request processed in 73us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906749.024325:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787906749.024354:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000291200:0@lo:103: 00000100:00100000:2.0:1787906749.024752:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000291072:0@lo:101: 00010000:00010000:2.0:1787906749.024769:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa5421fba00/0x72bb6cf063cad074 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad07b expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.024779:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa5421fba00/0x72bb6cf063cad074 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad07b expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906749.024809:0:6670:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787906749.024854:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa5421fba00/0x72bb6cf063cad074 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad07b expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.024862:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa5421fba00/0x72bb6cf063cad074 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad07b expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906749.024870:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787906749.024875:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787906749.024881:0:6670:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787906749.024883:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787906749.024902:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.024922:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.024930:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906749.024944:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000291328:0@lo:101: 00000100:00100000:2.0:1787906749.024975:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906749.027920:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906749.032801:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000291328 00000100:00100000:1.0:1787906749.032835:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000291328 00000100:00100000:1.0:1787906749.032904:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787906749.033106:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+10:6670:x1874756000291328:12345-0@lo:101: 00010000:00010000:1.0:1787906749.033125:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906749.033149:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa542174e00/0x72bb6cf063cad089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad082 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.033175:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa542174e00/0x72bb6cf063cad089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad082 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.033186:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa542174e00/0x72bb6cf063cad089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad082 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.033196:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa542174e00, rc 0) 00000100:00100000:1.0:1787906749.033292:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:6670:x1874756000291328:12345-0@lo:101: Request processed in 188us (8315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906749.033307:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787906749.033407:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000291328:0@lo:101: 00010000:00010000:2.0:1787906749.033425:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad089 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.033435:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad089 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906749.033592:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000291456:0@lo:501: 00000100:00100000:2.0:1787906749.033637:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906749.033675:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906749.034138:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000291456 00000100:00100000:1.0:1787906749.034145:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000291456 00000100:00100000:1.0:1787906749.034172:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787906749.034179:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:6670:x1874756000291456:12345-0@lo:501: 00000100:00100000:1.0:1787906749.034443:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:6670:x1874756000291456:12345-0@lo:501: Request processed in 264us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906749.034457:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787906749.034854:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000291456:0@lo:501: 00000100:00100000:2.0:1787906749.034890:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000291584:0@lo:503: 00000100:00100000:2.0:1787906749.035004:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906749.035036:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906749.035090:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000291584 00000100:00100000:1.0:1787906749.035095:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000291584 00000100:00100000:1.0:1787906749.035126:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787906749.035132:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:6670:x1874756000291584:12345-0@lo:503: 00000100:00100000:1.0:1787906749.035293:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:6670:x1874756000291584:12345-0@lo:503: Request processed in 160us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906749.035300:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787906749.035376:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000291584:0@lo:503: 00000040:00080000:2.0:1787906749.035803:0:6670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787906749.035898:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000291712:0@lo:502: 00000100:00100000:2.0:1787906749.036843:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906749.036881:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906749.037113:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000291712 00000100:00100000:1.0:1787906749.037120:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000291712 00000100:00100000:1.0:1787906749.037172:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787906749.037180:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:6670:x1874756000291712:12345-0@lo:502: 00000100:00100000:1.0:1787906749.037377:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:6670:x1874756000291712:12345-0@lo:502: Request processed in 198us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906749.037385:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787906749.038076:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000291712:0@lo:502: 00000040:00080000:2.0:1787906749.038381:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787906749.038434:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787906749.038469:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787906749.038533:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787906749.038584:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787906749.039809:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787906749.040207:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000291840:0@lo:502: 00000100:00100000:2.0:1787906749.040303:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906749.040353:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906749.040440:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000291840 00000100:00100000:1.0:1787906749.040449:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000291840 00000100:00100000:1.0:1787906749.040500:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787906749.040510:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:6670:x1874756000291840:12345-0@lo:502: 00000100:00100000:1.0:1787906749.040945:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:6670:x1874756000291840:12345-0@lo:502: Request processed in 436us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906749.040954:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787906749.041934:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000291840:0@lo:502: 00000040:00080000:2.0:1787906749.042092:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787906749.042132:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787906749.042997:0:6690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787906749.043007:0:6690:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787906749.043015:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787906749.043017:0:6690:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787906749.043021:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787906749.043041:0:6690:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8aa50311b370) 00000020:00000080:1.0:1787906749.043062:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787906749.043068:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787906749.043136:0:6690:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa510341800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787906749.043143:0:6690:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787906749.043150:0:6690:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72bb6cf063cad097 00010000:00010000:0.0:1787906749.052524:0:6690:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787906749.054261:0:6690:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787906749.066035:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787906749.066348:0:6690:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787906749.075049:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787906749.075545:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787906749.080368:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787906749.080380:0:6690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787906749.080386:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787906749.080389:0:6690:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787906749.080391:0:6690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787906749.080395:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787906749.080396:0:6690:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787906749.080399:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787906749.080401:0:6690:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787906749.080459:0:6690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787906749.080463:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787906749.080465:0:6690:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787906749.080469:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787906749.082873:0:6670:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787906749.082919:0:6670:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787906749.082940:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad089 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.082954:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad089 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906749.082963:0:6670:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa510341800 from 1 10000000:01000000:2.0:1787906749.082966:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787906749.083006:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.083014:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.083025:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906749.083049:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000291968:0@lo:101: 00000100:00100000:2.0:1787906749.083116:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906749.083156:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906749.084063:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000291968 00000100:00100000:1.0:1787906749.084083:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000291968 00000100:00100000:1.0:1787906749.084159:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787906749.084171:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:6670:x1874756000291968:12345-0@lo:101: 00010000:00010000:1.0:1787906749.084186:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906749.084203:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa542174600/0x72bb6cf063cad0a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad09e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.084233:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa542174600/0x72bb6cf063cad0a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad09e expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.084245:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa542174600/0x72bb6cf063cad0a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad09e expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.084255:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa542174600, rc 0) 00000100:00100000:1.0:1787906749.084325:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6670:x1874756000291968:12345-0@lo:101: Request processed in 156us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906749.084333:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787906749.085072:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000291968:0@lo:101: 00010000:00010000:2.0:1787906749.085092:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0a5 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906749.085102:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad0a5 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906749.085218:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292096:0@lo:501: 00000100:00100000:2.0:1787906749.085254:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906749.085288:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906749.085614:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000292096 00000100:00100000:1.0:1787906749.085630:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000292096 00000100:00100000:1.0:1787906749.085668:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787906749.085677:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6670:x1874756000292096:12345-0@lo:501: 00000100:00100000:1.0:1787906749.086724:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6670:x1874756000292096:12345-0@lo:501: Request processed in 1041us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906749.086746:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1787906749.087941:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906749.088139:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292096:0@lo:501: 00000100:00100000:2.0:1787906749.088191:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292224:0@lo:503: 00000100:00100000:2.0:1787906749.088254:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906749.088296:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787906749.088316:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000292224 00000100:00100000:2.0:1787906749.088322:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000292224 00000100:00100000:2.0:1787906749.088356:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787906749.088364:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6670:x1874756000292224:12345-0@lo:503: 00000100:00100000:2.0:1787906749.090310:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6670:x1874756000292224:12345-0@lo:503: Request processed in 1938us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906749.090325:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787906749.090504:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292224:0@lo:503: 00000040:00080000:3.0:1787906749.092492:0:6670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787906749.092614:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292352:0@lo:502: 00000100:00100000:3.0:1787906749.092702:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906749.092750:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa535d91f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906749.094856:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000292352 00000100:00100000:2.0:1787906749.094870:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000292352 00000100:00100000:2.0:1787906749.094946:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787906749.094957:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6670:x1874756000292352:12345-0@lo:502: 00000100:00100000:2.0:1787906749.095309:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6670:x1874756000292352:12345-0@lo:502: Request processed in 353us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906749.095317:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787906749.095617:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292352:0@lo:502: 00000040:00080000:1.0:1787906749.096166:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787906749.096222:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787906749.096258:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520aff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292480:0@lo:502: 00000100:00100000:1.0:1787906749.096316:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906749.096350:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa508255180 going to sleep for 11 seconds 00000100:00100000:3.0:1787906749.096447:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000292480 00000100:00100000:3.0:1787906749.096454:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000292480 00000100:00100000:3.0:1787906749.096488:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787906749.096496:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6670:x1874756000292480:12345-0@lo:502: 00000100:00100000:3.0:1787906749.096678:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6670:x1874756000292480:12345-0@lo:502: Request processed in 181us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906749.096685:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787906749.098061:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520aff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292480:0@lo:502: 00000040:00080000:1.0:1787906749.098225:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787906749.098242:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787906749.103110:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787906749.103125:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906749.103128:0:6694:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787906749.103134:0:6694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa510341800 00000020:00000080:2.0:1787906749.103143:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787906749.103164:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787906749.103167:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906749.103168:0:6694:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787906749.103171:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787906749.103680:0:6670:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787906749.103711:0:6670:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787906749.103740:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0a5 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906749.103754:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0a5 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906749.103870:0:6670:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787906749.103874:0:6670:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8aa510341800 10000000:01000000:3.0:1787906749.103877:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8aa510341800 10000000:01000000:3.0:1787906749.103881:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787906749.103888:0:6670:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8aa510341800 from 1 10000000:01000000:3.0:1787906749.103890:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787906749.104029:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906749.104038:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906749.104059:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906749.104083:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292608:0@lo:101: 00000100:00100000:3.0:1787906749.104150:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906749.104190:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa535d91d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906749.105395:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000292608 00000100:00100000:1.0:1787906749.105407:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000292608 00000100:00100000:1.0:1787906749.105457:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787906749.105467:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6670:x1874756000292608:12345-0@lo:101: 00010000:00010000:1.0:1787906749.105482:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906749.105498:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa542174400/0x72bb6cf063cad0b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad0ac expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.105530:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa542174400/0x72bb6cf063cad0b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad0ac expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.105541:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa542174400/0x72bb6cf063cad0b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad0ac expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.105550:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa542174400, rc 0) 00000100:00100000:1.0:1787906749.105607:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:6670:x1874756000292608:12345-0@lo:101: Request processed in 141us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906749.105624:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787906749.108987:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292608:0@lo:101: 00010000:00010000:3.0:1787906749.109022:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0b3 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906749.109035:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad0b3 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906749.109165:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292736:0@lo:501: 00000100:00100000:3.0:1787906749.109222:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906749.110844:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa535d91d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787906749.122794:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000292736 00000100:00100000:2.0:1787906749.122840:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000292736 00000100:00100000:2.0:1787906749.122913:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787906749.122925:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:6670:x1874756000292736:12345-0@lo:501: 00000100:00100000:2.0:1787906749.123283:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:6670:x1874756000292736:12345-0@lo:501: Request processed in 360us (14060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906749.123291:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787906749.123513:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292736:0@lo:501: 00000100:00100000:3.0:1787906749.123586:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292864:0@lo:503: 00000100:00100000:3.0:1787906749.123680:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906749.123732:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa535d91d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906749.123934:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000292864 00000100:00100000:1.0:1787906749.123941:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000292864 00000100:00100000:1.0:1787906749.123974:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787906749.123983:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:6670:x1874756000292864:12345-0@lo:503: 00000100:00100000:1.0:1787906749.124143:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:6670:x1874756000292864:12345-0@lo:503: Request processed in 160us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906749.124150:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787906749.124313:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292864:0@lo:503: 00000040:00080000:3.0:1787906749.124614:0:6670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787906749.124694:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292992:0@lo:502: 00000100:00100000:3.0:1787906749.124732:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906749.124759:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa535d91d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787906749.124950:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000292992 00000100:00100000:0.0:1787906749.124956:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000292992 00000100:00100000:0.0:1787906749.124980:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787906749.124986:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:6670:x1874756000292992:12345-0@lo:502: 00000100:00100000:0.0:1787906749.125166:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:6670:x1874756000292992:12345-0@lo:502: Request processed in 179us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906749.125173:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787906749.125417:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000292992:0@lo:502: 00000040:00080000:3.0:1787906749.125704:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787906749.125753:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787906749.125787:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787906749.125871:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787906749.126183:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787906749.126227:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787906749.126258:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787906749.126303:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787906749.126341:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787906749.126371:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787906749.126400:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787906749.126442:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787906749.126475:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787906749.126507:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787906749.127061:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787906749.127112:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787906749.127147:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787906749.127196:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787906749.127230:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787906749.127261:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787906749.127350:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787906749.127388:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787906749.127423:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787906749.127472:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787906749.127506:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787906749.127540:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787906749.129045:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787906749.129133:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787906749.129189:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000293120:0@lo:502: 00000100:00100000:3.0:1787906749.129286:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906749.129348:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa535d91d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906749.131099:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000293120 00000100:00100000:1.0:1787906749.131113:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000293120 00000100:00100000:1.0:1787906749.131182:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787906749.131193:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:6670:x1874756000293120:12345-0@lo:502: 00000100:00100000:1.0:1787906749.131476:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:6670:x1874756000293120:12345-0@lo:502: Request processed in 285us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906749.131484:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787906749.135336:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000293120:0@lo:502: 00000040:00080000:3.0:1787906749.135497:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787906749.135513:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787906749.139056:0:6695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787906749.139074:0:6695:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8aa510bd3370) 00000020:00000080:0.0:1787906749.139095:0:6695:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787906749.139193:0:6695:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa510341800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787906749.139198:0:6695:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa510341800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787906749.139201:0:6695:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa510341800 3 00010000:00080000:0.0:1787906749.139231:0:6695:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa40130d000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1787906749.157213:0:6695:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787906749.157481:0:6695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787906749.157562:0:6695:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787906749.157575:0:6695:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x72bb6cf063cad0c1 00000100:00080000:1.0:1787906749.157586:0:6695:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787906749.157592:0:6695:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8aa40130d000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1787906749.157638:0:6695:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa520aff100 x1874756000293248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787906749.157664:0:6695:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787906749.158893:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1874756000293248:0@lo:38: 00000100:00100000:0.0:1787906749.158976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906749.159166:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000293248 00000100:00100000:1.0:1787906749.159176:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000293248 00000100:00100000:1.0:1787906749.159229:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787906749.159237:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1874756000293248:12345-0@lo:38: 00010000:00080000:1.0:1787906749.159261:0:5830:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:1.0:1787906749.159306:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x72bb6cf063cad0c8 00000004:00100000:1.0:1787906749.159322:0:5830:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787906749.159353:0:5830:0:(import.c:65:import_set_state_nolock()) ffff8aa53f8c0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787906749.159409:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874756000293248:12345-0@lo:38: Request processed in 171us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906749.159417:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787906749.159550:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787906749.159561:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000293376:0@lo:400: 00000100:00100000:2.0:1787906749.159604:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906749.159635:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000293376 00000100:00100000:2.0:1787906749.159639:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000293376 00000100:00100000:2.0:1787906749.159670:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787906749.159677:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000293376:12345-0@lo:400: 00000100:00100000:2.0:1787906749.159716:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000293376:12345-0@lo:400: Request processed in 39us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906749.159722:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787906749.160154:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa520aff100 x1874756000293248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787906759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906749.160165:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787906749.160173:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787906749.160181:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787906749.160185:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787906749.160188:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa40130d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787906749.160194:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1874756000293248:0@lo:38: 00010000:00080000:2.0:1787906749.160246:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa541c1c700 x1874756000293376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906749.160256:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000293376:0@lo:400: 00000040:00080000:1.0:1787906749.161896:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787906749.162193:0:6670:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787906749.162223:0:6670:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787906749.162249:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0b3 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906749.162263:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0b3 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787906749.162323:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787906749.162326:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787906749.162327:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787906749.162328:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787906749.162330:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787906749.162331:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787906749.162333:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787906749.162334:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787906749.162341:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787906749.162343:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787906749.162345:0:6670:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787906749.162350:0:6670:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787906749.162352:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787906749.162353:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787906749.162355:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787906749.162356:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787906749.162357:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787906749.162358:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787906749.162359:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787906749.162360:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787906749.162361:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787906749.162362:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787906749.162363:0:6670:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787906749.162400:0:6670:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787906749.162418:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000293504:0@lo:253: 00000100:00100000:0.0:1787906749.162488:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906749.162840:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52f290600 going to sleep for 11 seconds 00000100:00100000:0.0:1787906749.163110:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000293504 00000100:00100000:0.0:1787906749.163118:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000293504 00000100:00100000:0.0:1787906749.163178:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787906749.163189:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:6670:x1874756000293504:12345-0@lo:253: 20000000:01000000:0.0:1787906749.163220:0:5823:0:(mgs_handler.c:454:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787906749.163235:0:5823:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787906749.223441:0:5823:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787906749.223462:0:5823:0:(mgs_handler.c:675:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787906749.223562:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787906749.223567:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787906749.223589:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.223725:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad020 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.223734:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.223776:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad020 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.223791:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad020 expref: 13 pid: 5825 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906749.223808:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1874756000293632:0@lo:104: 00000100:00100000:1.0:1787906749.224018:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906749.224729:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa508255780 going to sleep for 11 seconds 00000100:00100000:3.0:1787906749.230515:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000293632 00000100:00100000:3.0:1787906749.230532:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000293632 00000100:00100000:3.0:1787906749.230608:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787906749.230619:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:5846:x1874756000293632:12345-0@lo:104: 00010000:00010000:3.0:1787906749.230638:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa500031a00/0x72bb6cf063cad020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad027 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906749.230746:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787906749.230753:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:5846:x1874756000293632:12345-0@lo:104: Request processed in 136us (6735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906749.230760:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787906749.230789:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787906749.230795:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa500031a00/0x72bb6cf063cad020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad027 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906749.230803:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031a00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906749.230808:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa500031a00/0x72bb6cf063cad020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad027 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906749.230837:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa500031a00/0x72bb6cf063cad020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad027 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906749.230845:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa500031a00/0x72bb6cf063cad020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad027 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906749.230852:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787906749.230912:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa500031a00/0x72bb6cf063cad020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad027 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906749.230920:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906749.230939:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa500031a00/0x72bb6cf063cad020 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad027 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906749.230946:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa500031a00/0x72bb6cf063cad020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad027 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906749.230963:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906749.230965:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906749.230967:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906749.230984:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000293760:0@lo:103: 00000100:00100000:3.0:1787906749.231025:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906749.232081:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1874756000293632:0@lo:104: 00010000:00010000:1.0:1787906749.232107:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906749.232140:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000293760 00000100:00100000:1.0:1787906749.232146:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000293760 00010000:00010000:1.0:1787906749.232168:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad020 expref: 14 pid: 5825 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906749.232197:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787906749.232204:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510224050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:3303:x1874756000293760:12345-0@lo:103: 00010000:00010000:1.0:1787906749.232216:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906749.232222:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad020 expref: 14 pid: 5825 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.232234:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad020 expref: 14 pid: 5825 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.232248:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad020 expref: 14 pid: 5825 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.232264:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.232284:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787906749.232298:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008731249s 00010000:00010000:1.0:1787906749.232303:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.232324:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.232331:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.232338:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.232344:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa542175a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:1.0:1787906749.232348:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.232356:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.232368:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.232377:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906749.232423:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510224050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:3303:x1874756000293760:12345-0@lo:103: Request processed in 220us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906749.232430:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787906749.232473:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.232480:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906749.232487:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa542175a00/0x72bb6cf063cad0cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906749.232534:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000293760:0@lo:103: 00000100:00100000:0.0:1787906749.237288:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:6670:x1874756000293504:12345-0@lo:253: Request processed in 74079us (74778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906749.237303:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787906749.238029:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:6670:1874756000293504:0@lo:253: 10000000:01000000:1.0:1787906749.238047:0:6670:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787906749.238051:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787906749.238053:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787906749.238054:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787906749.238055:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787906749.238056:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787906749.238057:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787906749.238059:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787906749.238060:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787906749.238062:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787906749.238064:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787906749.238065:0:6670:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787906749.238083:0:6670:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787906749.244426:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787906749.244699:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787906749.245619:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787906749.246347:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787906749.255249:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787906749.256311:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787906749.271490:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787906749.750774:0:6670:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787906749.750782:0:6670:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787906749.750841:0:6670:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787906749.750909:0:6670:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787906749.750933:0:6670:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787906749.750956:0:6670:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787906750.111940:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906751.136994:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906752.162502:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906753.186871:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906754.212731:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906754.221656:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787906754.221685:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000293888:0@lo:400: 00000100:00100000:3.0:1787906754.221776:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906754.221900:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000294144:0@lo:400: 00000100:00100000:3.0:1787906754.221933:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906754.221952:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787906754.221958:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000294016:0@lo:400: 00000100:00100000:3.0:1787906754.221979:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906754.222227:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000293888 00000100:00100000:2.0:1787906754.222240:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000293888 00000100:00100000:2.0:1787906754.222308:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787906754.222320:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3303:x1874756000293888:12345-0@lo:400: 00000100:00100000:2.0:1787906754.222382:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3303:x1874756000293888:12345-0@lo:400: Request processed in 65us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906754.222390:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787906754.222428:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000294144 00000100:00100000:2.0:1787906754.222432:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000294144 00000100:00100000:2.0:1787906754.222468:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000294016 00000100:00100000:2.0:1787906754.222471:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000294016 00000100:00100000:2.0:1787906754.222484:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787906754.222491:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000294144:12345-0@lo:400: 00000100:00100000:2.0:1787906754.222541:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000294144:12345-0@lo:400: Request processed in 50us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906754.222546:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787906754.222558:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787906754.222563:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000294016:12345-0@lo:400: 00000100:00100000:2.0:1787906754.222589:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000294016:12345-0@lo:400: Request processed in 25us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906754.222594:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787906754.222635:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa503052a00 x1874756000294016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906754.222649:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000294016:0@lo:400: 00010000:00080000:2.0:1787906754.222684:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa503052d80 x1874756000294144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906754.222693:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000294144:0@lo:400: 00000100:00100000:2.0:1787906754.222725:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000293888:0@lo:400: 00000100:00080000:1.0:1787906754.224315:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787906755.232440:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906756.255950:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906757.280387:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787906757.441221:0:7038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787906758.317001:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787906758.822987:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787906758.822993:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8aa51a4db800 from 21 10000000:01000000:1.0:1787906758.822998:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787906758.823040:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906758.823053:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906758.823077:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906758.823111:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000294272:0@lo:101: 00000100:00100000:1.0:1787906758.823172:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906758.823222:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa516c95240 going to sleep for 11 seconds 00000100:00100000:2.0:1787906758.823276:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000294272 00000100:00100000:2.0:1787906758.823284:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000294272 00000100:00100000:2.0:1787906758.823333:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787906758.823342:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5827:x1874756000294272:12345-0@lo:101: 00010000:00010000:2.0:1787906758.823354:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906758.823374:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa5421fa600/0x72bb6cf063cad0dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad0d6 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906758.823399:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa5421fa600/0x72bb6cf063cad0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad0d6 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906758.823415:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa5421fa600/0x72bb6cf063cad0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad0d6 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906758.823424:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa5421fa600, rc 0) 00000100:00100000:2.0:1787906758.823470:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:5827:x1874756000294272:12345-0@lo:101: Request processed in 122us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906758.823476:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787906758.823664:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000294272:0@lo:101: 00010000:00010000:1.0:1787906758.823677:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0dd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906758.823686:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad0dd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906758.823738:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000294400:0@lo:501: 00000100:00100000:1.0:1787906758.823761:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906758.823782:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa516c95240 going to sleep for 11 seconds 00000100:00100000:2.0:1787906758.823860:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000294400 00000100:00100000:2.0:1787906758.823865:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000294400 00000100:00100000:2.0:1787906758.823888:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787906758.823894:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:5827:x1874756000294400:12345-0@lo:501: 00000100:00100000:2.0:1787906758.824221:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:5827:x1874756000294400:12345-0@lo:501: Request processed in 326us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906758.824234:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787906758.824311:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000294400:0@lo:501: 00000100:00100000:1.0:1787906758.824339:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000294528:0@lo:503: 00000100:00100000:1.0:1787906758.824388:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906758.824421:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa516c95240 going to sleep for 11 seconds 00000100:00100000:2.0:1787906758.824662:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000294528 00000100:00100000:2.0:1787906758.824667:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000294528 00000100:00100000:2.0:1787906758.824697:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787906758.824704:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:5827:x1874756000294528:12345-0@lo:503: 00000100:00100000:2.0:1787906758.825002:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:5827:x1874756000294528:12345-0@lo:503: Request processed in 297us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906758.825009:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787906758.825142:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000294528:0@lo:503: 00000100:00100000:3.0:1787906758.825685:0:7095:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503053100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7095:1874756000294656:0@lo:502: 00000100:00100000:3.0:1787906758.825727:0:7095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906758.825767:0:7095:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787906758.825982:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000294656 00000100:00100000:2.0:1787906758.825988:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000294656 00000100:00100000:3.0:1787906758.832153:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787906758.832170:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7095:x1874756000294656:12345-0@lo:502: 00000100:00100000:3.0:1787906758.833765:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7095:x1874756000294656:12345-0@lo:502: Request processed in 1589us (8026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906758.833779:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787906758.839739:0:7095:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503053100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7095:1874756000294656:0@lo:502: 00000100:00100000:0.0:1787906758.841719:0:7095:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510328380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7095:1874756000294784:0@lo:502: 00000100:00100000:0.0:1787906758.841923:0:7095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906758.844172:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000294784 00000100:00100000:3.0:1787906758.844188:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000294784 00000100:00100000:0.0:1787906758.856660:0:7095:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787906758.857011:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787906758.857025:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7095:x1874756000294784:12345-0@lo:502: 00000100:00100000:3.0:1787906758.857308:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7095:x1874756000294784:12345-0@lo:502: Request processed in 286us (15383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906758.857316:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787906758.857442:0:7095:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510328380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7095:1874756000294784:0@lo:502: 00000040:00080000:0.0:1787906758.857494:0:7095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787906758.857563:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787906758.857584:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787906758.857595:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0dd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906758.857605:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0dd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906758.857614:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787906758.857617:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8aa51a4db800 from 4 10000000:01000000:0.0:1787906758.857619:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787906758.857653:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906758.857662:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906758.857671:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906758.857687:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510328380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000294912:0@lo:101: 00000100:00100000:0.0:1787906758.857733:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906758.863777:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787906758.876654:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000294912 00000100:00100000:2.0:1787906758.876669:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000294912 00000100:00100000:2.0:1787906758.876769:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787906758.876780:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:5827:x1874756000294912:12345-0@lo:101: 00010000:00010000:2.0:1787906758.876797:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906758.876884:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa5421fb400/0x72bb6cf063cad0eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad0e4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906758.876917:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa5421fb400/0x72bb6cf063cad0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad0e4 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906758.876929:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa5421fb400/0x72bb6cf063cad0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad0e4 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906758.876940:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa5421fb400, rc 0) 00000100:00100000:2.0:1787906758.877041:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000294912:12345-0@lo:101: Request processed in 262us (19307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906758.877048:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787906758.879035:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510328380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000294912:0@lo:101: 00010000:00010000:1.0:1787906758.879063:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0eb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906758.879100:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad0eb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906758.880760:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000295040:0@lo:256: 00000100:00100000:1.0:1787906758.880865:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906758.880911:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa516c95240 going to sleep for 11 seconds 00000100:00100000:2.0:1787906758.880990:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000295040 00000100:00100000:2.0:1787906758.881000:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000295040 00000100:00100000:2.0:1787906758.881067:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787906758.881089:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000295040:12345-0@lo:256: 20000000:01000000:2.0:1787906758.881115:0:5823:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787906758.881136:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787906758.881140:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787906758.881228:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000295040:12345-0@lo:256: Request processed in 150us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906758.881235:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787906758.881317:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000295040:0@lo:256: 10000000:01000000:1.0:1787906758.881368:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787906758.881377:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0eb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906758.881386:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0eb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787906758.881396:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787906758.881398:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787906758.881401:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787906758.881437:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906758.881445:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906758.881453:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906758.883628:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000295168:0@lo:101: 00000100:00100000:1.0:1787906758.883713:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906758.883805:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa516c95240 going to sleep for 11 seconds 00000100:00100000:2.0:1787906758.889287:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000295168 00000100:00100000:2.0:1787906758.889300:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000295168 00000100:00100000:2.0:1787906758.889384:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787906758.889395:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000295168:12345-0@lo:101: 00010000:00010000:2.0:1787906758.889421:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906758.889442:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cad0f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad0f2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906758.889619:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cad0f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad0f2 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906758.889633:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cad0f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad0f2 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906758.889643:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa5421fae00, rc 0) 00000100:00100000:2.0:1787906758.889728:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000295168:12345-0@lo:101: Request processed in 335us (6014us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906758.889735:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787906758.889874:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000295168:0@lo:101: 00010000:00010000:1.0:1787906758.889893:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0f9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906758.889902:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad0f9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906758.889974:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000295296:0@lo:501: 00000100:00100000:1.0:1787906758.890012:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906758.890048:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa516c95240 going to sleep for 11 seconds 00000100:00100000:3.0:1787906758.890122:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000295296 00000100:00100000:3.0:1787906758.890128:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000295296 00000100:00100000:3.0:1787906758.890163:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787906758.890172:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000295296:12345-0@lo:501: 00000100:00100000:3.0:1787906758.890461:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000295296:12345-0@lo:501: Request processed in 290us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906758.890481:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787906758.890729:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000295296:0@lo:501: 00000100:00100000:1.0:1787906758.890762:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000295424:0@lo:503: 00000100:00100000:1.0:1787906758.890803:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906758.890864:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa516c95240 going to sleep for 11 seconds 00000100:00100000:1.0:1787906758.890879:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000295424 00000100:00100000:1.0:1787906758.890883:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000295424 00000100:00100000:1.0:1787906758.890912:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787906758.890919:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000295424:12345-0@lo:503: 00000100:00100000:1.0:1787906758.891232:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000295424:12345-0@lo:503: Request processed in 313us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906758.891239:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787906758.891273:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000295424:0@lo:503: 00000100:00100000:1.0:1787906758.891969:0:7098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7098:1874756000295552:0@lo:502: 00000100:00100000:1.0:1787906758.892022:0:7098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906758.892351:0:7098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50737bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906758.901325:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000295552 00000100:00100000:2.0:1787906758.901356:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000295552 00000100:00100000:3.0:1787906758.905133:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787906758.905159:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:7098:x1874756000295552:12345-0@lo:502: 00000100:00100000:3.0:1787906758.908858:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:7098:x1874756000295552:12345-0@lo:502: Request processed in 3701us (16825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906758.908874:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787906758.910136:0:7098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7098:1874756000295552:0@lo:502: 00000020:01000000:1.0:1787906758.910180:0:7098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787906758.910189:0:7098:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787906758.910197:0:7098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787906758.910199:0:7098:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787906758.910207:0:7098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787906758.910211:0:7098:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:1.0:1787906758.910236:0:7098:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787906758.910239:0:7098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787906758.910274:0:7098:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8aa5187c8000) 00000020:00000080:1.0:1787906758.910294:0:7098:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787906758.910300:0:7098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787906758.910387:0:7098:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787906758.910392:0:7098:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787906758.910400:0:7098:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bb6cf063cad107 00010000:00080000:1.0:1787906758.910444:0:7098:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa508a83000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1787906758.910689:0:7098:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787906759.051604:0:7098:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787906759.051632:0:7098:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787906759.052246:0:7098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787906759.052405:0:7098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787906759.052448:0:7098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787906759.054014:0:7098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787906759.057370:0:7108:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787906759.057378:0:7108:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787906759.062058:0:7098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787906759.062088:0:7098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787906759.062143:0:7098:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787906759.062171:0:7098:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bb6cf063cad10e 00000100:00080000:2.0:1787906759.062185:0:7098:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787906759.062193:0:7098:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8aa508a83000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1787906759.062241:0:7098:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa541c1c700 x1874756000295680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787906759.062265:0:7098:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787906759.062312:0:7098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787906759.062316:0:7098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906759.062318:0:7098:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787906759.062321:0:7098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787906759.062326:0:7098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906759.062328:0:7098:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787906759.062331:0:7098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787906759.062333:0:7098:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787906759.062357:0:7098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7098:1874756000295808:0@lo:502: 00000100:00100000:2.0:1787906759.062437:0:7098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906759.062485:0:7098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa517253f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906759.062508:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000295680:0@lo:8: 00000100:00100000:2.0:1787906759.062541:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906759.062608:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000295808 00000100:00100000:2.0:1787906759.062614:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000295808 00000100:00100000:2.0:1787906759.062652:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787906759.062661:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:7098:x1874756000295808:12345-0@lo:502: 00000100:00100000:2.0:1787906759.062899:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:7098:x1874756000295808:12345-0@lo:502: Request processed in 238us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906759.062914:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787906759.062951:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000295936:0@lo:400: 00000100:00100000:2.0:1787906759.062977:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906759.062997:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787906759.063002:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000296064:0@lo:400: 00000100:00100000:2.0:1787906759.063022:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906759.063064:0:7098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7098:1874756000295808:0@lo:502: 00000020:01000000:2.0:1787906759.063100:0:7098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787906759.063105:0:7098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906759.063106:0:7098:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787906759.063110:0:7098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1787906759.063217:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000295936 00000100:00100000:2.0:1787906759.063221:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000295936 00000100:00100000:2.0:1787906759.063245:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000296064 00000100:00100000:2.0:1787906759.063249:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000296064 00000100:00100000:2.0:1787906759.063273:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787906759.063280:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000295936:12345-0@lo:400: 00000100:00100000:2.0:1787906759.063314:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000295936:12345-0@lo:400: Request processed in 35us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906759.063320:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787906759.063329:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787906759.063335:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000296064:12345-0@lo:400: 00000100:00100000:2.0:1787906759.063355:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000296064:12345-0@lo:400: Request processed in 20us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906759.063360:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000020:01000000:2.0:1787906759.063374:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787906759.063393:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787906759.063406:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0f9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906759.063416:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad0f9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906759.063426:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787906759.063428:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8aa510bd0000 from 1 10000000:01000000:2.0:1787906759.063431:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787906759.063452:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906759.063460:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906759.063469:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906759.063479:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000296192:0@lo:101: 00000100:00100000:2.0:1787906759.063502:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906759.063524:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa517253f00 going to sleep for 11 seconds 00000100:00080000:2.0:1787906759.063539:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787906759.063557:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa541c1f480 x1874756000296064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906759.063568:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000296064:0@lo:400: 00010000:00080000:2.0:1787906759.063578:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa541c1c000 x1874756000295936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906759.063586:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000295936:0@lo:400: 00000100:00100000:2.0:1787906759.063606:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000296192 00000100:00100000:2.0:1787906759.063614:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000296192 00000100:00100000:2.0:1787906759.063631:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787906759.063637:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000296192:12345-0@lo:101: 00010000:00010000:2.0:1787906759.063644:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906759.063663:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa541c97400/0x72bb6cf063cad11c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad115 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906759.063683:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c97400/0x72bb6cf063cad11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad115 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906759.063692:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa541c97400/0x72bb6cf063cad11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad115 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906759.063701:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97400, rc 0) 00000100:00100000:2.0:1787906759.063725:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000296192:12345-0@lo:101: Request processed in 89us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906759.063731:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787906759.063756:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000296192:0@lo:101: 00010000:00010000:2.0:1787906759.063766:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad11c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906759.063775:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad11c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906759.063837:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000296320:0@lo:501: 00000100:00100000:2.0:1787906759.063864:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906759.063880:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa517253f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906759.063891:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000296320 00000100:00100000:2.0:1787906759.063894:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000296320 00000100:00100000:2.0:1787906759.063915:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787906759.063920:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000296320:12345-0@lo:501: 00000100:00100000:2.0:1787906759.064145:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000296320:12345-0@lo:501: Request processed in 224us (280us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787906759.064151:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787906759.064180:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000296320:0@lo:501: 10000000:01000000:2.0:1787906759.064197:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787906759.064203:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad11c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906759.064211:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad11c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906759.070628:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000295680 00000100:00100000:1.0:1787906759.070647:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000295680 00000100:00100000:1.0:1787906759.070697:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787906759.070707:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1874756000295680:12345-0@lo:8: 00010000:00080000:1.0:1787906759.070752:0:6673:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:1.0:1787906759.070781:0:6673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bb6cf063cad123 00002000:00100000:1.0:1787906759.070839:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8aa508a81000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113955 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787906759.070843:0:6673:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787906759.070847:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787906759.071006:0:6673:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787906759.071189:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787906759.071221:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8aa508a86000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787906759.071337:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1874756000295680:12345-0@lo:8: Request processed in 630us (8794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906759.071345:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787906759.076099:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa541c1c700 x1874756000295680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787906769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906759.076121:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787906759.076136:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787906759.076151:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787906759.076160:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787906759.076166:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa508a83000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787906759.076200:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787906759.076208:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000295680:0@lo:8: 00000004:00080000:2.0:1787906759.088385:0:7108:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787906759.088669:0:7108:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 197360855696ns, next at 0ns, rc = 0 00000004:00080000:1.0:1787906759.181205:0:7109:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787906759.181241:0:7109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520aff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7109:1874756000296576:0@lo:7: 00000100:00100000:1.0:1787906759.181325:0:7109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906759.181382:0:7109:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50737b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787906759.181432:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000296448:0@lo:13: 00000100:00100000:1.0:1787906759.181464:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906759.181503:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000296576 00000100:00100000:1.0:1787906759.181510:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000296576 00000100:00100000:1.0:1787906759.181577:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787906759.181586:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7109:x1874756000296576:12345-0@lo:7: 00000100:00100000:0.0:1787906759.184894:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000296448 00000100:00100000:0.0:1787906759.184909:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000296448 00000100:00100000:0.0:1787906759.184964:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787906759.184974:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874756000296448:12345-0@lo:13: 00002000:00000024:0.0:1787906759.185010:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787906759.185112:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874756000296448:12345-0@lo:13: Request processed in 139us (3646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906759.185120:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787906759.185883:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa520afdc00 x1874756000296448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906759.185915:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000296448:0@lo:13: 00000100:00080000:1.0:1787906759.185955:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1787906759.224933:0:6675:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787906759.224942:0:6675:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787906759.225048:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7109:x1874756000296576:12345-0@lo:7: Request processed in 43459us (43718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906759.225059:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787906759.225121:0:7109:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa520aff480 x1874756000296576/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787906775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906759.225157:0:7109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520aff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7109:1874756000296576:0@lo:7: 00000004:00080000:1.0:1787906759.225172:0:7109:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787906759.225209:0:7109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520aff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7109:1874756000296704:0@lo:5: 00000100:00100000:1.0:1787906759.225243:0:7109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906759.225279:0:7109:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50737b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787906759.225298:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000296704 00000100:00100000:1.0:1787906759.225304:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000296704 00000100:00100000:1.0:1787906759.225338:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787906759.225346:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7109:x1874756000296704:12345-0@lo:5: 00002000:00080000:1.0:1787906759.225372:0:6674:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787906759.225377:0:6674:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787906759.225587:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7109:x1874756000296704:12345-0@lo:5: Request processed in 241us (344us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787906759.225594:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787906759.225624:0:7109:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa520aff480 x1874756000296704/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787906775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906759.225635:0:7109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520aff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7109:1874756000296704:0@lo:5: 00000004:00080000:1.0:1787906759.225646:0:7109:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787906759.225673:0:7109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7109:1874756000296832:0@lo:700: 00000100:00100000:1.0:1787906759.225699:0:7109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906759.225719:0:7109:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50737b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787906759.225735:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000296832 00000100:00100000:1.0:1787906759.225739:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000296832 00000100:00100000:1.0:1787906759.225766:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787906759.225773:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7109:x1874756000296832:12345-0@lo:700: 00000100:00100000:1.0:1787906759.225844:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520affb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6681:1874756000296960:0@lo:700: 00000100:00100000:1.0:1787906759.225877:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906759.225895:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50737b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787906759.225916:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000296960 00000100:00100000:1.0:1787906759.225920:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000296960 00000100:00100000:1.0:1787906759.225946:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787906759.225952:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6681:x1874756000296960:12345-0@lo:700: 00000004:00080000:0.0:1787906759.262249:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787906759.329250:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1787906759.380165:0:5837:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787906759.391940:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6681:x1874756000296960:12345-0@lo:700: Request processed in 165976us (166050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906759.391978:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787906759.392043:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa520affb80 x1874756000296960/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787906775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906759.392058:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520affb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6681:1874756000296960:0@lo:700: 40000000:02000000:2.0:1787906759.392084:0:6681:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1787906759.582857:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1787906759.582883:0:6699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787906759.583120:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7109:x1874756000296832:12345-0@lo:700: Request processed in 357340us (357413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906759.583140:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787906759.583220:0:7109:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa520afe680 x1874756000296832/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787906775 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906759.583234:0:7109:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787906759.583257:0:7109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7109:1874756000296832:0@lo:700: 00000004:02000040:3.0:1787906759.667063:0:7109:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787906759.674267:0:7109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7109:1874756000297088:0@lo:5: 00000100:00100000:3.0:1787906759.675612:0:7109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906759.675663:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000297088 00000100:00100000:3.0:1787906759.675671:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000297088 00000100:00100000:3.0:1787906759.675739:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787906759.675749:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7109:x1874756000297088:12345-0@lo:5: 00000100:00100000:2.0:1787906759.680238:0:7109:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2840 going to sleep for 11 seconds 00002000:00080000:3.0:1787906759.689898:0:6674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787906759.689920:0:6674:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787906759.703425:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7109:x1874756000297088:12345-0@lo:5: Request processed in 27668us (27807us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787906759.703438:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787906759.704624:0:7109:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa503051880 x1874756000297088/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787906775 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906759.704645:0:7109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7109:1874756000297088:0@lo:5: 00000004:00080000:0.0:1787906759.704663:0:7109:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787906760.353184:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906761.399710:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906762.401397:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906763.424951:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787906764.017033:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1787906764.448121:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906764.450147:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000297216:0@lo:400: 00000100:00100000:3.0:1787906764.450260:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906764.450321:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787906764.450328:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000297600:0@lo:400: 00000100:00100000:3.0:1787906764.450358:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906764.450395:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000297600 00000100:00100000:3.0:1787906764.450403:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000297600 00000100:00100000:3.0:1787906764.450855:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787906764.450867:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000297600:12345-0@lo:400: 00000100:00100000:3.0:1787906764.450922:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000297600:12345-0@lo:400: Request processed in 58us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906764.450929:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787906764.450952:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787906764.450991:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa503051500 x1874756000297600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906764.451020:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787906764.451037:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000297600:0@lo:400: 00000100:00100000:1.0:1787906764.453437:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000297728:0@lo:13: 00000100:00100000:1.0:1787906764.453510:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906764.454379:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000297728 00000100:00100000:1.0:1787906764.454390:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000297728 00000100:00100000:1.0:1787906764.454513:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787906764.454526:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000297728:12345-0@lo:13: 00002000:00000024:1.0:1787906764.454696:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906764.455141:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000297728:12345-0@lo:13: Request processed in 616us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906764.455150:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787906764.455216:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa51032bb80 x1874756000297728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906764.455242:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000297728:0@lo:13: 00000100:00100000:2.0:1787906764.456322:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000297344:0@lo:400: 00000100:00100000:2.0:1787906764.456388:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906764.456434:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787906764.456441:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000297472:0@lo:400: 00000100:00100000:2.0:1787906764.456465:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906764.456509:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000297216 00000100:00100000:2.0:1787906764.456517:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000297216 00000100:00100000:1.0:1787906764.456625:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000297344 00000100:00100000:1.0:1787906764.456630:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000297344 00000100:00100000:1.0:1787906764.456664:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000297472 00000100:00100000:1.0:1787906764.456667:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000297472 00000100:00100000:1.0:1787906764.456693:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787906764.456701:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000297344:12345-0@lo:400: 00000100:00100000:1.0:1787906764.456780:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000297344:12345-0@lo:400: Request processed in 78us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906764.456787:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787906764.456801:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787906764.456807:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000297472:12345-0@lo:400: 00000100:00100000:1.0:1787906764.456853:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000297472:12345-0@lo:400: Request processed in 46us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906764.456859:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787906764.456891:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa503052a00 x1874756000297472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906764.456905:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000297472:0@lo:400: 00010000:00080000:1.0:1787906764.456914:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa503052d80 x1874756000297344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906764.456922:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000297344:0@lo:400: 00000100:00080000:1.0:1787906764.456942:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906764.457290:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787906764.457299:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:3302:x1874756000297216:12345-0@lo:400: 00000100:00100000:2.0:1787906764.457344:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:3302:x1874756000297216:12345-0@lo:400: Request processed in 48us (7086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906764.457351:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787906764.457854:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000297216:0@lo:400: 00010000:00010000:2.0:1787906765.475178:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906766.496799:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906767.520553:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906768.547384:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906769.568064:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906769.568184:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000297984:0@lo:400: 00000100:00100000:1.0:1787906769.568275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906769.568330:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787906769.568337:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000297856:0@lo:400: 00000100:00100000:1.0:1787906769.568370:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906769.568401:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000298112:0@lo:400: 00000100:00100000:1.0:1787906769.568440:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906769.568471:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906769.568484:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000298240:0@lo:400: 00000100:00100000:1.0:1787906769.568512:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906769.568548:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000297984 00000100:00100000:1.0:1787906769.568557:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000297984 00000100:00100000:1.0:1787906769.568617:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000298112 00000100:00100000:1.0:1787906769.568620:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000298112 00000100:00100000:1.0:1787906769.568665:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787906769.568676:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000297984:12345-0@lo:400: 00000100:00100000:1.0:1787906769.568739:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000297984:12345-0@lo:400: Request processed in 65us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906769.568746:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787906769.568764:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787906769.568771:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000298112:12345-0@lo:400: 00000100:00100000:1.0:1787906769.568804:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000298112:12345-0@lo:400: Request processed in 34us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906769.568841:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787906769.568862:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000297856 00000100:00100000:1.0:1787906769.568866:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000297856 00000100:00100000:1.0:1787906769.568905:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787906769.568912:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:3304:x1874756000297856:12345-0@lo:400: 00000100:00100000:1.0:1787906769.568960:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:3304:x1874756000297856:12345-0@lo:400: Request processed in 48us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906769.568967:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1787906769.569110:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787906769.569151:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa520aff480 x1874756000298112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906769.569168:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000298112:0@lo:400: 00000100:00100000:1.0:1787906769.569205:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000297856:0@lo:400: 00010000:00080000:1.0:1787906769.569218:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa520afe680 x1874756000297984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906769.569228:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000297984:0@lo:400: 00000100:00100000:3.0:1787906769.569687:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000298240 00000100:00100000:3.0:1787906769.569694:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000298240 00000100:00100000:3.0:1787906769.569738:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787906769.569745:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000298240:12345-0@lo:400: 00000100:00080000:2.0:1787906769.574772:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906769.575294:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787906769.575321:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000298368:0@lo:13: 00000100:00100000:0.0:1787906769.575421:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906769.575699:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000298368 00000100:00100000:0.0:1787906769.575721:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000298368 00000100:00100000:0.0:1787906769.575779:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787906769.575791:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874756000298368:12345-0@lo:13: 00002000:00000024:0.0:1787906769.576060:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906769.576124:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874756000298368:12345-0@lo:13: Request processed in 334us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906769.576132:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787906769.576181:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa51032b800 x1874756000298368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906769.576209:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000298368:0@lo:13: 00010000:00080000:0.0:1787906769.580038:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa520affb80 x1874756000298240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906769.580061:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000298240:0@lo:400: 00000100:00100000:3.0:1787906769.580343:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000298240:12345-0@lo:400: Request processed in 10597us (11827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906769.580355:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787906770.594073:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906771.616366:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787906772.109693:0:7620:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787906772.109698:0:7620:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787906772.109913:0:7620:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8aa401350800 00000020:01000004:3.0:1787906772.109928:0:7620:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787906772.110014:0:7620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787906772.110028:0:7620:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8aa507390000) 00000020:00000080:3.0:1787906772.110050:0:7620:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787906772.160395:0:7620:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787906772.160931:0:7620:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787906772.201626:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787906772.216601:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787906772.216646:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787906772.216709:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787906772.216737:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787906772.217880:0:7620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787906772.217893:0:7620:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787906772.217904:0:7620:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72bb6cf063cad131 00000020:01000004:2.0:1787906772.217912:0:7620:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787906772.217935:0:7620:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787906772.217938:0:7620:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787906772.217944:0:7620:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787906772.217966:0:7620:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787906772.217970:0:7620:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787906772.233391:0:7620:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787906772.233433:0:7620:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.120@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787906772.233437:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787906772.233439:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787906772.233440:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787906772.233442:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787906772.233443:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787906772.233444:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787906772.233446:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787906772.233447:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787906772.233452:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787906772.233453:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787906772.233455:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787906772.233458:0:7620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787906772.233460:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787906772.233461:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787906772.233462:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787906772.233463:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787906772.233464:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787906772.233465:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787906772.233465:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787906772.233466:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787906772.233467:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787906772.233468:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787906772.233468:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787906772.233498:0:7620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787906772.233516:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000298496:0@lo:253: 00000100:00100000:3.0:1787906772.233593:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906772.233729:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a29b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787906772.233774:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000298496 00000100:00100000:1.0:1787906772.233782:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000298496 00000100:00100000:1.0:1787906772.234025:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787906772.234035:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:7620:x1874756000298496:12345-0@lo:253: 20000000:01000000:1.0:1787906772.234064:0:5824:0:(mgs_handler.c:480:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787906772.234068:0:5824:0:(mgs_handler.c:538:mgs_target_reg()) Checking nodemap for target registration lustre-OST0001 20000000:01000000:1.0:1787906772.234071:0:5824:0:(mgs_handler.c:544:mgs_target_reg()) lustre-OST0001: Nodemap subsystem disabled, allowing target registration 20000000:01000000:1.0:1787906772.234075:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787906772.234079:0:5824:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787906772.234082:0:5824:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787906772.235034:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787906772.235256:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787906772.235270:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787906772.235310:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787906772.235319:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787906772.235350:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787906772.235401:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787906772.235783:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787906772.235808:0:5824:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.120@tcp 20000000:01000000:1.0:1787906772.235853:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:1.0:1787906772.235890:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787906772.235899:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787906772.235946:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787906772.235953:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:1.0:1787906772.235993:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787906772.236002:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787906772.236030:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787906772.236091:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787906772.237097:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787906772.237118:0:5824:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.120@tcp 20000000:01000000:1.0:1787906772.237120:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:1.0:1787906772.237159:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787906772.237167:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787906772.237217:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787906772.237225:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:1.0:1787906772.237258:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787906772.237267:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787906772.237314:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787906772.237347:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787906772.237362:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787906772.237364:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787906772.237368:0:5824:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787906772.237382:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787906772.237386:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787906772.237421:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787906772.237424:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787906772.238240:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787906772.238313:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787906772.238344:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787906772.238641:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787906772.238686:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787906772.238740:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787906772.238755:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787906772.238757:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787906772.239264:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787906772.239311:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787906772.239363:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787906772.239573:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787906772.239612:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787906772.239680:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787906772.239694:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787906772.239696:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787906772.240100:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787906772.240312:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787906772.240342:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787906772.240389:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787906772.240399:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787906772.240401:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787906772.241096:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787906772.241152:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787906772.241217:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787906772.241473:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1787906772.241509:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1787906772.241539:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1787906772.241554:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787906772.241556:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787906772.241564:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787906772.241583:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.241602:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa542174e00/0x72bb6cf063cad089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad082 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.241610:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa542174400/0x72bb6cf063cad0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad0ac expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.241616:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa5421fa600/0x72bb6cf063cad0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad0d6 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.241622:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cad0f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad0f2 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.241627:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa541c97400/0x72bb6cf063cad11c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad115 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.241634:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.241672:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa541c97400/0x72bb6cf063cad11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad115 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.241690:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa541c97400/0x72bb6cf063cad11c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad115 expref: 16 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906772.241706:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1874756000298624:0@lo:104: 00000100:00100000:2.0:1787906772.241781:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787906772.241924:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cad0f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad0f2 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.241932:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cad0f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad0f2 expref: 16 pid: 5825 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906772.241940:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1874756000298752:0@lo:104: 00010000:00010000:2.0:1787906772.241960:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa5421fa600/0x72bb6cf063cad0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad0d6 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.241967:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa5421fa600/0x72bb6cf063cad0dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad0d6 expref: 16 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906772.241972:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1874756000298880:0@lo:104: 00010000:00010000:2.0:1787906772.241987:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa542174400/0x72bb6cf063cad0b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad0ac expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.241993:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa542174400/0x72bb6cf063cad0b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad0ac expref: 16 pid: 5824 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906772.242000:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1874756000299008:0@lo:104: 00010000:00010000:2.0:1787906772.242014:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa542174e00/0x72bb6cf063cad089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad082 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.242031:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa542174e00/0x72bb6cf063cad089 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad082 expref: 16 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906772.242038:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1874756000299136:0@lo:104: 00000100:00100000:2.0:1787906772.242053:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa508a42e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787906772.242160:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787906772.242178:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906772.242201:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906772.242250:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906772.242307:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906772.242337:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000298624 00000100:00100000:0.0:1787906772.242344:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000298624 00000100:00100000:0.0:1787906772.242375:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000298752 00000100:00100000:0.0:1787906772.242377:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000298752 00000100:00100000:0.0:1787906772.242387:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000298880 00000100:00100000:0.0:1787906772.242388:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000298880 00000100:00100000:0.0:1787906772.242395:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000299008 00000100:00100000:0.0:1787906772.242397:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000299008 00000100:00100000:0.0:1787906772.242408:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787906772.242416:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5172c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+6:5824:x1874756000298624:12345-0@lo:104: 00010000:00010000:0.0:1787906772.242428:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad11c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242499:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787906772.242504:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5172c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+6:5824:x1874756000298624:12345-0@lo:104: Request processed in 89us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906772.242511:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787906772.242551:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787906772.242557:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+5:5824:x1874756000298752:12345-0@lo:104: 00010000:00010000:0.0:1787906772.242564:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad0f9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242592:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787906772.242597:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+5:5824:x1874756000298752:12345-0@lo:104: Request processed in 41us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906772.242602:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787906772.242613:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787906772.242617:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503050380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:5824:x1874756000298880:12345-0@lo:104: 00010000:00010000:0.0:1787906772.242624:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad0dd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242645:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787906772.242649:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503050380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:5824:x1874756000298880:12345-0@lo:104: Request processed in 32us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906772.242654:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787906772.242665:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787906772.242670:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503051f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:5824:x1874756000299008:12345-0@lo:104: 00010000:00010000:0.0:1787906772.242676:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad0b3 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242708:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787906772.242713:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503051f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:5824:x1874756000299008:12345-0@lo:104: Request processed in 43us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906772.242718:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787906772.242736:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787906772.242742:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad11c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242750:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fbe00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:0.0:1787906772.242754:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad11c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242763:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad11c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787906772.242770:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad11c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906772.242776:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787906772.242806:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad11c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242846:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787906772.242864:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad11c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242870:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbe00/0x72bb6cf063cad115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad11c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242895:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787906772.242899:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad0f9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242906:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa542175a00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:0.0:1787906772.242909:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad0f9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242915:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad0f9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787906772.242921:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad0f9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906772.242926:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787906772.242939:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0f9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242944:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787906772.242956:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0f9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242962:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa542175a00/0x72bb6cf063cad0f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0f9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242972:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787906772.242975:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad0dd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.242990:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa542174a00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:0.0:1787906772.242993:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad0dd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243000:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad0dd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787906772.243005:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad0dd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906772.243010:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787906772.243023:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0dd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243028:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787906772.243033:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0dd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243038:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa542174a00/0x72bb6cf063cad0d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0dd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243048:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787906772.243051:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad0b3 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243056:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511994800 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:0.0:1787906772.243059:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad0b3 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243074:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad0b3 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787906772.243079:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad0b3 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906772.243085:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787906772.243098:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0b3 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243103:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787906772.243109:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0b3 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243114:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa511994800/0x72bb6cf063cad0ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0b3 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243123:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906772.243124:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906772.243126:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906772.243139:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000299264:0@lo:103: 00000100:00100000:0.0:1787906772.243173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906772.243195:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787906772.243200:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000299648:0@lo:103: 00000100:00100000:0.0:1787906772.243221:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906772.243246:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000299392:0@lo:103: 00000100:00100000:0.0:1787906772.243267:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906772.243285:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787906772.243297:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000299520:0@lo:103: 00000100:00100000:0.0:1787906772.243320:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906772.243342:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000299264 00000100:00100000:0.0:1787906772.243347:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000299264 00010000:00010000:0.0:1787906772.243369:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa541c97400/0x72bb6cf063cad11c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad115 expref: 17 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906772.243384:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000299648 00000100:00100000:0.0:1787906772.243387:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000299648 00010000:00010000:0.0:1787906772.243397:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa542174400/0x72bb6cf063cad0b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad0ac expref: 18 pid: 5824 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906772.243407:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000299392 00000100:00100000:0.0:1787906772.243409:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000299392 00010000:00010000:0.0:1787906772.243418:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cad0f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad0f2 expref: 19 pid: 5825 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906772.243426:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000299520 00000100:00100000:0.0:1787906772.243428:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000299520 00010000:00010000:0.0:1787906772.243436:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa5421fa600/0x72bb6cf063cad0dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad0d6 expref: 20 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906772.243447:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787906772.243454:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa51032ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+20:3304:x1874756000299264:12345-0@lo:103: 00010000:00010000:0.0:1787906772.243465:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906772.243471:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa541c97400/0x72bb6cf063cad11c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad115 expref: 20 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243480:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa541c97400/0x72bb6cf063cad11c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad115 expref: 20 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243500:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906772.243536:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa51032ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+20:3304:x1874756000299264:12345-0@lo:103: Request processed in 82us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906772.243543:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787906772.243557:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787906772.243563:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510329180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000299648:12345-0@lo:103: 00010000:00010000:0.0:1787906772.243569:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906772.243574:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa542174400/0x72bb6cf063cad0b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad0ac expref: 19 pid: 5824 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243581:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa542174400/0x72bb6cf063cad0b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad0ac expref: 19 pid: 5824 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243590:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906772.243607:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510329180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000299648:12345-0@lo:103: Request processed in 45us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906772.243611:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787906772.243621:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787906772.243626:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa51032bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:3301:x1874756000299392:12345-0@lo:103: 00010000:00010000:0.0:1787906772.243633:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906772.243637:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cad0f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad0f2 expref: 18 pid: 5825 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243644:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cad0f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad0f2 expref: 18 pid: 5825 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243652:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906772.243674:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa51032bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:3301:x1874756000299392:12345-0@lo:103: Request processed in 48us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906772.243679:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787906772.243696:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787906772.243702:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:3301:x1874756000299520:12345-0@lo:103: 00010000:00010000:0.0:1787906772.243710:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906772.243714:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa5421fa600/0x72bb6cf063cad0dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad0d6 expref: 17 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243722:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa5421fa600/0x72bb6cf063cad0dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad0d6 expref: 17 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.243731:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906772.243752:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:3301:x1874756000299520:12345-0@lo:103: Request processed in 51us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906772.243757:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787906772.243789:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000299520:0@lo:103: 00000100:00100000:0.0:1787906772.243796:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000299392:0@lo:103: 00000100:00100000:0.0:1787906772.243857:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000299648:0@lo:103: 00000100:00100000:0.0:1787906772.243863:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000299264:0@lo:103: 00010000:00010000:1.0:1787906772.243985:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa541c97400/0x72bb6cf063cad11c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad115 expref: 16 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906772.243996:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1874756000298624:0@lo:104: 00010000:00010000:1.0:1787906772.244005:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa5421fae00/0x72bb6cf063cad0f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad0f2 expref: 15 pid: 5825 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906772.244013:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1874756000298752:0@lo:104: 00010000:00010000:1.0:1787906772.244021:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa5421fa600/0x72bb6cf063cad0dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad0d6 expref: 14 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906772.244030:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1874756000298880:0@lo:104: 00010000:00010000:1.0:1787906772.244040:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa542174400/0x72bb6cf063cad0b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad0ac expref: 13 pid: 5824 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906772.244047:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1874756000299008:0@lo:104: 00000100:00100000:3.0:1787906772.244296:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000299136 00000100:00100000:3.0:1787906772.244303:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000299136 00000100:00100000:2.0:1787906772.244425:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787906772.244436:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503050000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:5824:x1874756000299136:12345-0@lo:104: 00010000:00010000:2.0:1787906772.244447:0:6688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad089 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.244497:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787906772.244502:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503050000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:5824:x1874756000299136:12345-0@lo:104: Request processed in 70us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906772.244508:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787906772.244533:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787906772.244539:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad089 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.244546:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fbc00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:0.0:1787906772.244550:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad089 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.244558:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad089 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787906772.244577:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad089 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906772.244582:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787906772.244605:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1874756000299136:0@lo:104: 00010000:00010000:0.0:1787906772.244619:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad089 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.244625:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787906772.244631:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.244638:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad089 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.244644:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa5421fbc00/0x72bb6cf063cad082 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad089 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.244662:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906772.244664:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906772.244666:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906772.244672:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1787906772.244761:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906772.244930:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000299776:0@lo:103: 00000100:00100000:0.0:1787906772.245022:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.245118:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000299776 00000100:00100000:1.0:1787906772.245123:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000299776 00010000:00010000:1.0:1787906772.245145:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa542174e00/0x72bb6cf063cad089 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad082 expref: 13 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906772.245205:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787906772.245220:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa51032aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:3303:x1874756000299776:12345-0@lo:103: 00010000:00010000:1.0:1787906772.245231:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906772.245236:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa542174e00/0x72bb6cf063cad089 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad082 expref: 13 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.245251:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa542174e00/0x72bb6cf063cad089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad082 expref: 13 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.245264:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa542174e00/0x72bb6cf063cad089 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad082 expref: 13 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.245279:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.245289:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.245305:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.245312:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.245320:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.245326:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.245332:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96800 already unused, calling callback (ffffffffc1439230) 00010000:00010000:1.0:1787906772.245336:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.245350:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.245370:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.245380:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906772.245422:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa51032aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3303:x1874756000299776:12345-0@lo:103: Request processed in 204us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906772.245428:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787906772.245484:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.245491:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.245497:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad138 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787906772.245509:0:5824:0:(mgs_handler.c:675:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787906772.245614:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000299776:0@lo:103: 00000100:00100000:0.0:1787906772.300222:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:7620:x1874756000298496:12345-0@lo:253: Request processed in 66168us (66608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906772.300247:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787906772.300380:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000298496:0@lo:253: 10000000:01000000:1.0:1787906772.300397:0:7620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787906772.300401:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787906772.300402:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787906772.300404:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787906772.300405:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787906772.300407:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787906772.300408:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787906772.300410:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787906772.300412:0:7620:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787906772.300414:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787906772.300415:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787906772.300440:0:7620:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8aa401350800 from lustre-OST0001 10000000:01000000:1.0:1787906772.300539:0:7620:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787906772.300544:0:7620:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787906772.300556:0:7620:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8aa510bd0000 local copy 10000000:01000000:1.0:1787906772.300562:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787906772.300612:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.300622:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.300644:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906772.300660:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000299904:0@lo:101: 00000100:00100000:1.0:1787906772.300694:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.300764:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5183cf000 going to sleep for 11 seconds 00000100:00100000:2.0:1787906772.300796:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000299904 00000100:00100000:2.0:1787906772.300802:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000299904 00000100:00100000:3.0:1787906772.300962:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787906772.300973:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+11:7620:x1874756000299904:12345-0@lo:101: 00010000:00010000:3.0:1787906772.300987:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906772.301002:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad146 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad13f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906772.301123:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad13f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906772.301145:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad13f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906772.301154:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511995600, rc 0) 00000100:00100000:3.0:1787906772.301224:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:7620:x1874756000299904:12345-0@lo:101: Request processed in 254us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.301228:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787906772.301271:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000299904:0@lo:101: 00010000:00010000:1.0:1787906772.301281:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x72bb6cf063cad146 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.301288:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72bb6cf063cad146 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906772.301375:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000300032:0@lo:501: 00000100:00100000:1.0:1787906772.301394:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.301441:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5183cf000 going to sleep for 11 seconds 00000100:00100000:0.0:1787906772.301513:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000300032 00000100:00100000:0.0:1787906772.301517:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000300032 00000100:00100000:0.0:1787906772.301540:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787906772.301545:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:7620:x1874756000300032:12345-0@lo:501: 00000100:00100000:0.0:1787906772.301800:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:7620:x1874756000300032:12345-0@lo:501: Request processed in 254us (404us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787906772.301807:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787906772.301932:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000300032:0@lo:501: 10000000:01000000:1.0:1787906772.301944:0:7620:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787906772.301965:0:7620:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787906772.301969:0:7620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72bb6cf063cad146 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.301977:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72bb6cf063cad146 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.301984:0:7620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72bb6cf063cad146 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.302044:0:7620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787906772.302068:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8aa401350800 10000000:01000000:1.0:1787906772.302073:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787906772.302078:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787906772.302080:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787906772.302084:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787906772.302087:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787906772.302103:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.302111:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.302119:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906772.302130:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000300160:0@lo:101: 00000100:00100000:1.0:1787906772.302157:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.302184:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5183cfc00 going to sleep for 11 seconds 00010000:00010000:0.0:1787906772.302236:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787906772.302241:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000300160 00010000:00010000:0.0:1787906772.302243:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x72bb6cf063cad146 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906772.302246:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000300160 00010000:00010000:0.0:1787906772.302251:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210c00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:0.0:1787906772.302254:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x72bb6cf063cad146 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.302262:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x72bb6cf063cad146 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787906772.302270:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x72bb6cf063cad146 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906772.302276:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787906772.302294:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bb6cf063cad146 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.302300:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787906772.302307:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787906772.302314:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:7620:x1874756000300160:12345-0@lo:101: 00010000:00010000:3.0:1787906772.302322:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906772.302328:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bb6cf063cad146 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906772.302330:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511995a00/0x72bb6cf063cad154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad14d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.302336:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa508210c00/0x72bb6cf063cad13f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bb6cf063cad146 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906772.302344:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511995a00/0x72bb6cf063cad154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad14d expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.302347:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906772.302349:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906772.302352:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511995a00/0x72bb6cf063cad154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad14d expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.302355:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906772.302359:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511995a00, rc 0) 00000100:00100000:0.0:1787906772.302363:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787906772.302373:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000300288:0@lo:103: 00000100:00100000:3.0:1787906772.302385:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7620:x1874756000300160:12345-0@lo:101: Request processed in 72us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.302391:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787906772.302397:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906772.302423:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000300288 00000100:00100000:0.0:1787906772.302427:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000300288 00000100:00100000:1.0:1787906772.302451:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000300160:0@lo:101: 00000100:00100000:0.0:1787906772.302453:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787906772.302459:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510329500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:3302:x1874756000300288:12345-0@lo:103: 00010000:00010000:0.0:1787906772.302467:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906772.302472:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad154 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.302477:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad146 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cad13f expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.302480:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad154 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.302487:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906772.302511:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510329500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3302:x1874756000300288:12345-0@lo:103: Request processed in 53us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906772.302518:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787906772.302529:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000300416:0@lo:501: 00000100:00100000:0.0:1787906772.302542:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000300288:0@lo:103: 00000100:00100000:1.0:1787906772.302560:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.302691:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5183cfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906772.302749:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000300416 00000100:00100000:2.0:1787906772.302753:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000300416 00000100:00100000:2.0:1787906772.302783:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787906772.302790:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:7620:x1874756000300416:12345-0@lo:501: 00000100:00100000:3.0:1787906772.303065:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:7620:x1874756000300416:12345-0@lo:501: Request processed in 275us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.303073:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787906772.303146:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000300416:0@lo:501: 00000100:00100000:1.0:1787906772.303165:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000300544:0@lo:503: 00000100:00100000:1.0:1787906772.303193:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.303212:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5183cfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787906772.303229:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000300544 00000100:00100000:3.0:1787906772.303233:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000300544 00000100:00100000:3.0:1787906772.303257:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787906772.303263:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:7620:x1874756000300544:12345-0@lo:503: 00000100:00100000:3.0:1787906772.303383:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:7620:x1874756000300544:12345-0@lo:503: Request processed in 120us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.303390:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787906772.303407:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000300544:0@lo:503: 00000040:00080000:1.0:1787906772.303718:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787906772.303785:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000300672:0@lo:502: 00000100:00100000:1.0:1787906772.303869:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.303898:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5183cfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787906772.303934:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000300672 00000100:00100000:3.0:1787906772.303939:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000300672 00000100:00100000:3.0:1787906772.303995:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787906772.304006:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:7620:x1874756000300672:12345-0@lo:502: 00000100:00100000:3.0:1787906772.304184:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:7620:x1874756000300672:12345-0@lo:502: Request processed in 178us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.304191:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787906772.304359:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000300672:0@lo:502: 00000040:00080000:1.0:1787906772.304728:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787906772.304781:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787906772.304857:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787906772.304920:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787906772.304954:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787906772.304986:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787906772.305013:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000300800:0@lo:502: 00000100:00100000:1.0:1787906772.305050:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.305081:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5183cfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787906772.305147:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000300800 00000100:00100000:3.0:1787906772.305153:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000300800 00000100:00100000:3.0:1787906772.305189:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787906772.305196:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:7620:x1874756000300800:12345-0@lo:502: 00000100:00100000:3.0:1787906772.305365:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:7620:x1874756000300800:12345-0@lo:502: Request processed in 169us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.305371:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787906772.305506:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000300800:0@lo:502: 00000040:00080000:1.0:1787906772.305589:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787906772.305598:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787906772.306609:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787906772.306616:0:7627:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787906772.306621:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787906772.306623:0:7627:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787906772.306628:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787906772.306639:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8aa507393370) 00000020:00000080:3.0:1787906772.306783:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787906772.306790:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787906772.306886:0:7627:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa401350800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787906772.306893:0:7627:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787906772.306900:0:7627:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72bb6cf063cad162 00010000:00010000:3.0:1787906772.310564:0:7627:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787906772.310971:0:7627:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787906772.315863:0:7627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787906772.316182:0:7627:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787906772.322340:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787906772.323960:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787906772.325792:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787906772.325802:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787906772.326488:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906772.326493:0:7627:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787906772.326500:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787906772.326507:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906772.326509:0:7627:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787906772.326512:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787906772.326515:0:7627:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787906772.326570:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787906772.326573:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906772.326575:0:7627:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787906772.326578:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787906772.326676:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787906772.326703:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787906772.328390:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad154 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.328413:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad154 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787906772.328423:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa401350800 from 1 10000000:01000000:1.0:1787906772.328426:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787906772.328480:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.328489:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.328502:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906772.329213:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000300928:0@lo:101: 00000100:00100000:1.0:1787906772.329288:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.329376:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5183cff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787906772.329443:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000300928 00000100:00100000:3.0:1787906772.329463:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000300928 00000100:00100000:3.0:1787906772.329730:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787906772.329744:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:7620:x1874756000300928:12345-0@lo:101: 00010000:00010000:3.0:1787906772.329764:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906772.329785:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad170 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad169 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906772.330050:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad169 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906772.330066:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad169 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906772.330077:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511995400, rc 0) 00000100:00100000:3.0:1787906772.330140:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7620:x1874756000300928:12345-0@lo:101: Request processed in 398us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.330210:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787906772.330764:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000300928:0@lo:101: 00010000:00010000:1.0:1787906772.330783:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad170 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.330794:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad170 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906772.331256:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301056:0@lo:501: 00000100:00100000:1.0:1787906772.331295:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.331336:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5183cff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787906772.333656:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000301056 00000100:00100000:3.0:1787906772.333670:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000301056 00000100:00100000:3.0:1787906772.333795:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787906772.333808:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7620:x1874756000301056:12345-0@lo:501: 00000100:00100000:3.0:1787906772.334429:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7620:x1874756000301056:12345-0@lo:501: Request processed in 621us (3129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.334440:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787906772.334776:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301056:0@lo:501: 00000100:00100000:0.0:1787906772.334869:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301184:0@lo:503: 00000100:00100000:0.0:1787906772.334924:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906772.334966:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787906772.334979:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000301184 00000100:00100000:1.0:1787906772.334986:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000301184 00000100:00100000:1.0:1787906772.335024:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787906772.335032:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7620:x1874756000301184:12345-0@lo:503: 00000100:00100000:1.0:1787906772.335446:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7620:x1874756000301184:12345-0@lo:503: Request processed in 412us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906772.335453:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787906772.336359:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301184:0@lo:503: 00000040:00080000:0.0:1787906772.336787:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787906772.336913:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301312:0@lo:502: 00000100:00100000:0.0:1787906772.336989:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906772.337040:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787906772.337247:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000301312 00000100:00100000:3.0:1787906772.337256:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000301312 00000100:00100000:3.0:1787906772.337310:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787906772.337320:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7620:x1874756000301312:12345-0@lo:502: 00000100:00100000:1.0:1787906772.338674:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301312:0@lo:502: 00000100:00100000:3.0:1787906772.341799:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7620:x1874756000301312:12345-0@lo:502: Request processed in 4466us (4796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.341841:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000040:00080000:1.0:1787906772.343035:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787906772.344988:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787906772.345628:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301440:0@lo:502: 00000100:00100000:0.0:1787906772.345733:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906772.345782:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787906772.346000:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000301440 00000100:00100000:1.0:1787906772.346009:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000301440 00000100:00100000:1.0:1787906772.346077:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787906772.346089:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7620:x1874756000301440:12345-0@lo:502: 00000100:00100000:1.0:1787906772.346419:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7620:x1874756000301440:12345-0@lo:502: Request processed in 331us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906772.346427:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787906772.346800:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301440:0@lo:502: 00000040:00080000:0.0:1787906772.347016:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787906772.347031:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787906772.349336:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787906772.349352:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787906772.349355:0:7631:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787906772.349365:0:7631:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa401350800 00000020:00000080:3.0:1787906772.349368:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787906772.349386:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787906772.349389:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787906772.349390:0:7631:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787906772.349393:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787906772.349543:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787906772.349591:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787906772.349622:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad170 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.349638:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad170 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787906772.349690:0:7620:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787906772.349694:0:7620:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8aa401350800 10000000:01000000:1.0:1787906772.349697:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8aa401350800 10000000:01000000:1.0:1787906772.349721:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787906772.349727:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8aa401350800 from 1 10000000:01000000:1.0:1787906772.349731:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787906772.349781:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.349790:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.349804:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906772.349862:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301568:0@lo:101: 00000100:00100000:1.0:1787906772.349947:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906772.349992:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000301568 00000100:00100000:1.0:1787906772.349992:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5183cfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787906772.350003:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000301568 00000100:00100000:2.0:1787906772.350308:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787906772.350322:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7620:x1874756000301568:12345-0@lo:101: 00010000:00010000:2.0:1787906772.350338:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906772.350353:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad17e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad177 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.350378:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad177 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.350390:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad177 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906772.350398:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96800, rc 0) 00000100:00100000:2.0:1787906772.350460:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:7620:x1874756000301568:12345-0@lo:101: Request processed in 142us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906772.350467:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787906772.350688:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301568:0@lo:101: 00010000:00010000:1.0:1787906772.350705:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad17e expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.350715:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad17e expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906772.351026:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301696:0@lo:501: 00000100:00100000:1.0:1787906772.351067:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.351102:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5183cfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787906772.351158:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000301696 00000100:00100000:3.0:1787906772.351165:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000301696 00000100:00100000:3.0:1787906772.351207:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787906772.351216:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:7620:x1874756000301696:12345-0@lo:501: 00000100:00100000:3.0:1787906772.351540:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:7620:x1874756000301696:12345-0@lo:501: Request processed in 325us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.351556:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787906772.351727:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301696:0@lo:501: 00000100:00100000:1.0:1787906772.351764:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301824:0@lo:503: 00000100:00100000:1.0:1787906772.351805:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.351870:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5183cfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787906772.352000:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000301824 00000100:00100000:0.0:1787906772.352006:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000301824 00000100:00100000:0.0:1787906772.352033:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787906772.352041:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:7620:x1874756000301824:12345-0@lo:503: 00000100:00100000:0.0:1787906772.352211:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:7620:x1874756000301824:12345-0@lo:503: Request processed in 170us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906772.352218:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787906772.352268:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301824:0@lo:503: 00000040:00080000:0.0:1787906772.352797:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787906772.352958:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301952:0@lo:502: 00000100:00100000:0.0:1787906772.353013:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906772.353097:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787906772.353263:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000301952 00000100:00100000:1.0:1787906772.353271:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000301952 00000100:00100000:1.0:1787906772.353346:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787906772.353355:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:7620:x1874756000301952:12345-0@lo:502: 00000100:00100000:1.0:1787906772.353589:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:7620:x1874756000301952:12345-0@lo:502: Request processed in 234us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906772.353596:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787906772.353682:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000301952:0@lo:502: 00000040:00080000:2.0:1787906772.354047:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787906772.354104:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787906772.354137:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787906772.354182:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787906772.354219:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787906772.354270:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787906772.354307:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787906772.354344:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787906772.354387:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787906772.354436:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787906772.354470:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787906772.354517:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787906772.354552:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787906772.354585:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787906772.354627:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787906772.354662:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787906772.354693:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787906772.354755:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787906772.354795:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787906772.354874:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787906772.354923:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787906772.354956:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787906772.354991:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787906772.355038:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787906772.355076:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787906772.355146:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787906772.355211:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787906772.355258:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787906772.355292:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787906772.355358:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787906772.355394:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787906772.355424:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787906772.355452:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787906772.355498:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787906772.355533:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787906772.355579:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787906772.355614:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787906772.355671:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000302080:0@lo:502: 00000100:00100000:2.0:1787906772.355771:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906772.355874:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa508a42540 going to sleep for 11 seconds 00000100:00100000:3.0:1787906772.356281:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000302080 00000100:00100000:3.0:1787906772.356289:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000302080 00000100:00100000:3.0:1787906772.356328:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787906772.356343:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:7620:x1874756000302080:12345-0@lo:502: 00000100:00100000:3.0:1787906772.356632:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:7620:x1874756000302080:12345-0@lo:502: Request processed in 289us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.356640:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787906772.358506:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000302080:0@lo:502: 00000040:00080000:2.0:1787906772.358726:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787906772.358744:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787906772.359936:0:7632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787906772.359959:0:7632:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8aa52ebc0000) 00000020:00000080:2.0:1787906772.359985:0:7632:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1787906772.360092:0:7632:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa401350800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787906772.360097:0:7632:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa401350800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787906772.360099:0:7632:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa401350800 3 00010000:00080000:2.0:1787906772.360151:0:7632:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa53b056800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1787906772.363261:0:7632:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1787906772.363571:0:7632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787906772.363615:0:7632:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787906772.363629:0:7632:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x72bb6cf063cad18c 00000100:00080000:2.0:1787906772.363641:0:7632:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787906772.363646:0:7632:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8aa53b056800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1787906772.363684:0:7632:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa541c1ea00 x1874756000302208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787906772.363724:0:7632:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787906772.363933:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906772.363947:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000302336:0@lo:400: 00000100:00100000:1.0:1787906772.364021:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.364072:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000302336 00000100:00100000:1.0:1787906772.364079:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000302336 00000100:00100000:1.0:1787906772.364126:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787906772.364136:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000302336:12345-0@lo:400: 00000100:00100000:1.0:1787906772.364199:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000302336:12345-0@lo:400: Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906772.364206:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787906772.364254:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa520aff480 x1874756000302336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906772.364270:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000302336:0@lo:400: 00000100:00100000:3.0:1787906772.364486:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1874756000302208:0@lo:38: 00000100:00100000:3.0:1787906772.364525:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906772.364579:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000302208 00000100:00100000:3.0:1787906772.364583:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000302208 00000100:00100000:3.0:1787906772.364607:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787906772.364612:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1874756000302208:12345-0@lo:38: 00010000:00080000:3.0:1787906772.364634:0:5830:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1787906772.364685:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x72bb6cf063cad193 00000004:00100000:3.0:1787906772.364705:0:5830:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787906772.364752:0:5830:0:(import.c:65:import_set_state_nolock()) ffff8aa534cac800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787906772.364797:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874756000302208:12345-0@lo:38: Request processed in 183us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.364804:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787906772.364862:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa541c1ea00 x1874756000302208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787906782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906772.364871:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787906772.364878:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787906772.364887:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787906772.364891:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787906772.364894:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa53b056800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787906772.364900:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1874756000302208:0@lo:38: 00000100:00100000:1.0:1787906772.365205:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000302464:0@lo:400: 00000100:00100000:1.0:1787906772.365243:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.365270:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787906772.365277:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000302592:0@lo:400: 00000100:00100000:1.0:1787906772.365302:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.365329:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000302464 00000100:00100000:1.0:1787906772.365341:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000302464 00000100:00100000:1.0:1787906772.365377:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787906772.365384:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000302464:12345-0@lo:400: 00000100:00100000:1.0:1787906772.365421:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000302464:12345-0@lo:400: Request processed in 38us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906772.365427:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787906772.365453:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa520afe300 x1874756000302464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906772.365463:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000302464:0@lo:400: 00000100:00080000:2.0:1787906772.365773:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906772.365867:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000302592 00000100:00100000:3.0:1787906772.365877:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000302592 00000100:00100000:3.0:1787906772.365921:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787906772.365928:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000302592:12345-0@lo:400: 00000100:00100000:3.0:1787906772.365982:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000302592:12345-0@lo:400: Request processed in 55us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.365990:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787906772.366065:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787906772.366268:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:1.0:1787906772.366624:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa520afd500 x1874756000302592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906772.366637:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000302592:0@lo:400: 00000100:00100000:3.0:1787906772.366751:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7633:1874756000302720:0@lo:901: 00000100:00100000:3.0:1787906772.366790:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906772.366856:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a29540 going to sleep for 11 seconds 00000100:00100000:1.0:1787906772.367180:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000302720 00000100:00100000:1.0:1787906772.367187:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000302720 00000100:00100000:1.0:1787906772.367253:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787906772.367261:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7633:x1874756000302720:12345-0@lo:901: 00000100:00080000:2.0:1787906772.367650:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906772.368175:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7633:x1874756000302720:12345-0@lo:901: Request processed in 911us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906772.368186:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:0.0:1787906772.370433:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787906772.370491:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787906772.370524:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad17e expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.370537:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad17e expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787906772.370589:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787906772.370596:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787906772.370597:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787906772.370598:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787906772.370599:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787906772.370601:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787906772.370602:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787906772.370603:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787906772.370605:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787906772.370606:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787906772.370607:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787906772.370612:0:7620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787906772.370614:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787906772.370615:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787906772.370616:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787906772.370617:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787906772.370618:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787906772.370618:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787906772.370619:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787906772.370620:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787906772.370621:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787906772.370622:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787906772.370623:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787906772.370658:0:7620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787906772.370678:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000302848:0@lo:253: 00000100:00100000:0.0:1787906772.370759:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906772.370848:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000302848 00000100:00100000:0.0:1787906772.370856:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000302848 00000100:00100000:0.0:1787906772.370903:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787906772.370913:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:7620:x1874756000302848:12345-0@lo:253: 20000000:01000000:0.0:1787906772.370939:0:5824:0:(mgs_handler.c:454:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787906772.370953:0:5824:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1787906772.373556:0:7633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa503051500 x1874756000302720/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787906788 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906772.373585:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7633:1874756000302720:0@lo:901: 00000100:00100000:1.0:1787906772.374919:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c20c0 going to sleep for 11 seconds 20000000:01000000:0.0:1787906772.420781:0:5824:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787906772.420908:0:5824:0:(mgs_handler.c:675:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787906772.422393:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787906772.422405:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787906772.422435:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.422478:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa5421fb400/0x72bb6cf063cad0eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad0e4 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.422709:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.422769:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa5421fb400/0x72bb6cf063cad0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad0e4 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906772.422786:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa5421fb400/0x72bb6cf063cad0eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad0e4 expref: 14 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906772.422804:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1874756000302976:0@lo:104: 00000100:00100000:1.0:1787906772.422915:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.422963:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5183cf480 going to sleep for 11 seconds 00000100:00100000:3.0:1787906772.423041:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000302976 00000100:00100000:3.0:1787906772.423050:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000302976 00000100:00100000:3.0:1787906772.423107:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787906772.423118:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:5846:x1874756000302976:12345-0@lo:104: 00010000:00010000:3.0:1787906772.423132:0:6688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad0eb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906772.423265:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787906772.423272:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:5846:x1874756000302976:12345-0@lo:104: Request processed in 156us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.423280:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787906772.423307:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787906772.423313:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad0eb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906772.423320:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031200 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906772.423340:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad0eb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906772.423357:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad0eb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906772.423368:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad0eb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906772.423378:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787906772.423430:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0eb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906772.423441:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906772.423503:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0eb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906772.423516:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad0e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0eb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906772.423744:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906772.423746:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906772.423748:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906772.423996:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000303104:0@lo:103: 00000100:00100000:1.0:1787906772.424083:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906772.424330:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1874756000302976:0@lo:104: 00010000:00010000:1.0:1787906772.424372:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906772.424852:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000303104 00000100:00100000:0.0:1787906772.424861:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000303104 00010000:00010000:0.0:1787906772.424900:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa5421fb400/0x72bb6cf063cad0eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad0e4 expref: 15 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906772.424954:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787906772.424962:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510224450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:3301:x1874756000303104:12345-0@lo:103: 00010000:00010000:0.0:1787906772.424978:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906772.424983:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa5421fb400/0x72bb6cf063cad0eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad0e4 expref: 15 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.424993:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa5421fb400/0x72bb6cf063cad0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad0e4 expref: 15 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.425012:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa5421fb400/0x72bb6cf063cad0eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad0e4 expref: 15 pid: 5823 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.425029:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.425037:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787906772.425054:0:5816:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008731249s 00010000:00010000:0.0:1787906772.425059:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.425066:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.425073:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.425080:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.425094:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211400 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787906772.425098:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.425105:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.425123:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.425135:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906772.425362:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510224450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:3301:x1874756000303104:12345-0@lo:103: Request processed in 397us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906772.425374:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787906772.425683:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.425692:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906772.425699:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa508211400/0x72bb6cf063cad19a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906772.425741:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000303104:0@lo:103: 00000100:00100000:3.0:1787906772.444512:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:7620:x1874756000302848:12345-0@lo:253: Request processed in 73592us (73744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906772.444637:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787906772.444923:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17707cff-d1ec-407e-b5de-6f2bf29614ad:7620:1874756000302848:0@lo:253: 10000000:01000000:2.0:1787906772.444949:0:7620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787906772.444954:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787906772.444956:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787906772.444957:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787906772.444959:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787906772.444960:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787906772.444961:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787906772.444963:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787906772.444965:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787906772.444966:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787906772.444969:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787906772.444970:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787906772.445002:0:7620:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787906772.453337:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787906772.453690:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787906772.453992:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787906772.454273:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787906772.454599:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787906772.455077:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787906772.456090:0:7620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787906772.639551:0:7620:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787906772.639561:0:7620:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787906772.639605:0:7620:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787906772.639775:0:7620:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787906772.639800:0:7620:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787906772.639985:0:7620:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787906772.644327:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906773.669094:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906774.687969:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906774.689012:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000303232:0@lo:13: 00000100:00100000:2.0:1787906774.689106:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906774.689249:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000303232 00000100:00100000:0.0:1787906774.689259:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000303232 00000100:00080000:2.0:1787906774.689314:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906774.689353:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787906774.689371:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000303232:12345-0@lo:13: 00002000:00000024:0.0:1787906774.689408:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906774.689479:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000303232:12345-0@lo:13: Request processed in 115us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906774.689488:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787906774.689517:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa51032ad80 x1874756000303232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906774.689553:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000303232:0@lo:13: 00010000:00010000:1.0:1787906775.712004:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906776.736980:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906777.760165:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906777.765942:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787906777.765980:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000303360:0@lo:400: 00000100:00100000:0.0:1787906777.766076:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906777.766183:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000303488:0@lo:400: 00000100:00100000:0.0:1787906777.766227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906777.766270:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000303488 00000100:00100000:0.0:1787906777.766281:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000303488 00000100:00100000:2.0:1787906777.766345:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000303360 00000100:00100000:2.0:1787906777.766431:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000303360 00000100:00100000:2.0:1787906777.766477:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787906777.766490:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:3304:x1874756000303360:12345-0@lo:400: 00000100:00100000:2.0:1787906777.766558:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:3304:x1874756000303360:12345-0@lo:400: Request processed in 71us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906777.766598:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787906777.766909:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787906777.766930:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000303488:12345-0@lo:400: 00000100:00100000:0.0:1787906777.766971:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000303488:12345-0@lo:400: Request processed in 45us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906777.766977:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787906777.767034:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa51032bb80 x1874756000303488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906777.767051:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000303488:0@lo:400: 00000100:00100000:0.0:1787906777.767064:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000303360:0@lo:400: 00000100:00100000:0.0:1787906777.767127:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787906777.767138:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000303616:0@lo:400: 00000100:00100000:0.0:1787906777.767170:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906777.767204:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000303616 00000100:00100000:0.0:1787906777.767208:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000303616 00000100:00100000:0.0:1787906777.770227:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787906777.770246:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa51032bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000303616:12345-0@lo:400: 00000100:00100000:2.0:1787906777.770464:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787906777.770485:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000303744:0@lo:400: 00000100:00100000:2.0:1787906777.770562:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906777.770845:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000303744 00000100:00100000:3.0:1787906777.770858:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000303744 00000100:00100000:3.0:1787906777.770899:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787906777.770909:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000303744:12345-0@lo:400: 00000100:00100000:3.0:1787906777.772381:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000303744:12345-0@lo:400: Request processed in 1390us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906777.772398:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787906777.772561:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa51032bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000303616:12345-0@lo:400: Request processed in 1969us (5038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906777.772572:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787906777.772608:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787906777.772615:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906777.772638:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000303872:0@lo:400: 00000100:00100000:0.0:1787906777.772712:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906777.772775:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000303872 00000100:00100000:0.0:1787906777.772782:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000303872 00000100:00100000:0.0:1787906777.772861:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787906777.772873:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa51032aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000303872:12345-0@lo:400: 00010000:00080000:1.0:1787906777.773230:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa520afd500 x1874756000303744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906777.774939:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000303744:0@lo:400: 00000100:00100000:0.0:1787906777.776879:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa51032aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000303872:12345-0@lo:400: Request processed in 3998us (4156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906777.776898:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787906777.777117:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510329180 x1874756000303616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906777.777138:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000303616:0@lo:400: 00000100:00080000:0.0:1787906777.777668:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787906777.777868:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa520afd880 x1874756000303872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906777.777882:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000303872:0@lo:400: 00010000:00010000:3.0:1787906778.786048:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906779.813030:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906779.826231:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787906779.826259:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000304000:0@lo:13: 00000100:00100000:0.0:1787906779.826331:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906779.826630:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000304000 00000100:00100000:1.0:1787906779.826639:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000304000 00000100:00100000:1.0:1787906779.826716:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787906779.826727:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510329c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000304000:12345-0@lo:13: 00002000:00000024:1.0:1787906779.826770:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906779.826850:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510329c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000304000:12345-0@lo:13: Request processed in 125us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906779.826858:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787906779.826914:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510329500 x1874756000304000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906779.826934:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000304000:0@lo:13: 00000100:00080000:0.0:1787906779.827600:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787906780.831993:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787906781.747368:0:7975:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1787906781.858618:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787906781.858626:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8aa510341800 from 30 10000000:01000000:0.0:1787906781.858631:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787906781.858688:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.858721:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.858732:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906781.858755:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000304128:0@lo:101: 00000100:00100000:0.0:1787906781.858847:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.858894:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787906781.859673:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000304128 00000100:00100000:3.0:1787906781.859684:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000304128 00000100:00100000:3.0:1787906781.859741:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787906781.859752:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:5827:x1874756000304128:12345-0@lo:101: 00010000:00010000:3.0:1787906781.859778:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906781.859793:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511995200/0x72bb6cf063cad1a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad1a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906781.859839:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511995200/0x72bb6cf063cad1a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad1a1 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906781.859851:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511995200/0x72bb6cf063cad1a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad1a1 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906781.859861:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511995200, rc 0) 00000100:00100000:3.0:1787906781.859924:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000304128:12345-0@lo:101: Request processed in 173us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906781.859931:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00010000:3.0:1787906781.859966:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906781.859994:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000304128:0@lo:101: 00010000:00010000:3.0:1787906781.860010:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1a8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906781.860020:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad1a8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906781.860087:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503050a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000304256:0@lo:501: 00000100:00100000:3.0:1787906781.860119:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906781.860146:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534e69480 going to sleep for 11 seconds 00000100:00100000:3.0:1787906781.860161:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000304256 00000100:00100000:3.0:1787906781.860165:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000304256 00000100:00100000:3.0:1787906781.860187:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787906781.860193:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000304256:12345-0@lo:501: 00000100:00100000:3.0:1787906781.862872:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000304256:12345-0@lo:501: Request processed in 2663us (2737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906781.862894:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787906781.863091:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503050a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000304256:0@lo:501: 00000100:00100000:0.0:1787906781.863176:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510328e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000304384:0@lo:503: 00000100:00100000:0.0:1787906781.863232:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.863401:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787906781.863619:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000304384 00000100:00100000:3.0:1787906781.863627:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000304384 00000100:00100000:3.0:1787906781.863687:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787906781.863697:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000304384:12345-0@lo:503: 00000100:00100000:3.0:1787906781.864774:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000304384:12345-0@lo:503: Request processed in 1075us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906781.864786:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787906781.866415:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510328e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000304384:0@lo:503: 00000100:00100000:3.0:1787906781.868909:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503053b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7981:1874756000304512:0@lo:502: 00000100:00100000:3.0:1787906781.869028:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906781.869077:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534e69600 going to sleep for 11 seconds 00000100:00100000:1.0:1787906781.870040:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000304512 00000100:00100000:1.0:1787906781.870050:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000304512 00000100:00100000:1.0:1787906781.870124:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787906781.870140:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:7981:x1874756000304512:12345-0@lo:502: 00000100:00100000:2.0:1787906781.871120:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:7981:x1874756000304512:12345-0@lo:502: Request processed in 981us (2088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906781.871133:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787906781.871452:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503053b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7981:1874756000304512:0@lo:502: 00000100:00100000:1.0:1787906781.872298:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7981:1874756000304640:0@lo:502: 00000100:00100000:1.0:1787906781.872360:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906781.872404:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787906781.874577:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000304640 00000100:00100000:3.0:1787906781.874593:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000304640 00000100:00100000:3.0:1787906781.874673:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787906781.874686:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:7981:x1874756000304640:12345-0@lo:502: 00000100:00100000:3.0:1787906781.875012:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:7981:x1874756000304640:12345-0@lo:502: Request processed in 329us (2651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906781.875021:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787906781.875959:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7981:1874756000304640:0@lo:502: 00000040:00080000:1.0:1787906781.876003:0:7981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787906781.876399:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787906781.876432:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787906781.876443:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1a8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.876456:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1a8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906781.876466:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787906781.876469:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787906781.876472:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787906781.876667:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.876686:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.876697:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906781.876718:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510328e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000304768:0@lo:101: 00000100:00100000:0.0:1787906781.876777:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.876849:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787906781.876978:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000304768 00000100:00100000:3.0:1787906781.876988:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000304768 00000100:00100000:3.0:1787906781.877055:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787906781.877067:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000304768:12345-0@lo:101: 00010000:00010000:3.0:1787906781.877080:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906781.877096:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511994a00/0x72bb6cf063cad1b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad1af expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906781.877147:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511994a00/0x72bb6cf063cad1b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad1af expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906781.877169:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511994a00/0x72bb6cf063cad1b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad1af expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906781.877178:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511994a00, rc 0) 00000100:00100000:3.0:1787906781.877226:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000304768:12345-0@lo:101: Request processed in 162us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906781.877233:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787906781.877701:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510328e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000304768:0@lo:101: 00010000:00010000:1.0:1787906781.877715:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1b6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906781.877724:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad1b6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906781.877784:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000304896:0@lo:501: 00000100:00100000:1.0:1787906781.877841:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906781.877864:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787906781.877932:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000304896 00000100:00100000:3.0:1787906781.877937:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000304896 00000100:00100000:3.0:1787906781.877971:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787906781.877978:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000304896:12345-0@lo:501: 00000100:00100000:3.0:1787906781.878666:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000304896:12345-0@lo:501: Request processed in 686us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906781.878675:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787906781.882096:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000304896:0@lo:501: 00000100:00100000:1.0:1787906781.882176:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000305024:0@lo:503: 00000100:00100000:1.0:1787906781.882256:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906781.885861:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787906781.887685:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000305024 00000100:00100000:3.0:1787906781.887700:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000305024 00000100:00100000:3.0:1787906781.887832:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787906781.887845:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000305024:12345-0@lo:503: 00000100:00100000:3.0:1787906781.888414:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000305024:12345-0@lo:503: Request processed in 571us (6156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906781.888552:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787906781.888693:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000305024:0@lo:503: 00000100:00100000:2.0:1787906781.888947:0:7983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7983:1874756000305152:0@lo:502: 00000100:00100000:2.0:1787906781.889001:0:7983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906781.892002:0:7983:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa517253b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787906781.892109:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000305152 00000100:00100000:1.0:1787906781.892120:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000305152 00000100:00100000:0.0:1787906781.892516:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787906781.892531:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:7983:x1874756000305152:12345-0@lo:502: 00000100:00100000:0.0:1787906781.892922:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:7983:x1874756000305152:12345-0@lo:502: Request processed in 394us (3920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906781.892931:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787906781.893093:0:7983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7983:1874756000305152:0@lo:502: 00000020:01000000:2.0:1787906781.893131:0:7983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787906781.893141:0:7983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906781.893143:0:7983:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787906781.893149:0:7983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787906781.893162:0:7983:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787906781.893196:0:7983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7983:1874756000305280:0@lo:502: 00000100:00100000:2.0:1787906781.893242:0:7983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906781.893283:0:7983:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa517253b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787906781.893547:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000305280 00000100:00100000:0.0:1787906781.893554:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000305280 00000100:00100000:0.0:1787906781.893579:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787906781.893586:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:7983:x1874756000305280:12345-0@lo:502: 00000100:00100000:0.0:1787906781.893750:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:7983:x1874756000305280:12345-0@lo:502: Request processed in 163us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906781.893756:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787906781.893923:0:7983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7983:1874756000305280:0@lo:502: 00000020:01000000:2.0:1787906781.893944:0:7983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787906781.893948:0:7983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906781.893950:0:7983:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787906781.893954:0:7983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787906781.894117:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787906781.894144:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787906781.894167:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1b6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.894178:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1b6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906781.894195:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787906781.894198:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8aa51a4db800 from 30 10000000:01000000:0.0:1787906781.894200:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787906781.894229:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.894237:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.894246:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906781.894260:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000305408:0@lo:101: 00000100:00100000:0.0:1787906781.894304:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.894333:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906781.894446:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000305408 00000100:00100000:2.0:1787906781.894457:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000305408 00000100:00100000:2.0:1787906781.894501:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787906781.894510:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000305408:12345-0@lo:101: 00010000:00010000:2.0:1787906781.894519:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906781.894533:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa541c96400/0x72bb6cf063cad1c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad1bd expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906781.894556:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c96400/0x72bb6cf063cad1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad1bd expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906781.894566:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa541c96400/0x72bb6cf063cad1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad1bd expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906781.894576:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96400, rc 0) 00000100:00100000:2.0:1787906781.894608:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000305408:12345-0@lo:101: Request processed in 100us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906781.894614:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787906781.894805:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000305408:0@lo:101: 00010000:00010000:0.0:1787906781.894846:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1c4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.894857:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad1c4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906781.894902:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000305536:0@lo:501: 00000100:00100000:0.0:1787906781.894927:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.894943:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787906781.894957:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000305536 00000100:00100000:0.0:1787906781.894960:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000305536 00000100:00100000:0.0:1787906781.894978:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787906781.894991:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000305536:12345-0@lo:501: 00000100:00100000:0.0:1787906781.895233:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000305536:12345-0@lo:501: Request processed in 242us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906781.895241:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787906781.895583:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000305536:0@lo:501: 00000100:00100000:0.0:1787906781.895614:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000305664:0@lo:503: 00000100:00100000:0.0:1787906781.895659:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.895713:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906781.895743:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000305664 00000100:00100000:2.0:1787906781.895748:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000305664 00000100:00100000:2.0:1787906781.895802:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787906781.895824:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000305664:12345-0@lo:503: 00000100:00100000:2.0:1787906781.895961:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000305664:12345-0@lo:503: Request processed in 152us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906781.895968:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787906781.896036:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000305664:0@lo:503: 00000100:00100000:0.0:1787906781.896216:0:7984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7984:1874756000305792:0@lo:502: 00000100:00100000:0.0:1787906781.896250:0:7984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.896279:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000305792 00000100:00100000:0.0:1787906781.896283:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000305792 00000100:00100000:0.0:1787906781.896301:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787906781.896308:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:7984:x1874756000305792:12345-0@lo:502: 00000100:00100000:0.0:1787906781.896470:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:7984:x1874756000305792:12345-0@lo:502: Request processed in 162us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906781.896656:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787906781.896690:0:7984:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787906781.896702:0:7984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7984:1874756000305792:0@lo:502: 00000100:00100000:0.0:1787906781.896738:0:7984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7984:1874756000305920:0@lo:502: 00000100:00100000:0.0:1787906781.896767:0:7984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.896785:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000305920 00000100:00100000:0.0:1787906781.896788:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000305920 00000100:00100000:0.0:1787906781.896803:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787906781.896833:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:7984:x1874756000305920:12345-0@lo:502: 00000100:00100000:0.0:1787906781.896945:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:7984:x1874756000305920:12345-0@lo:502: Request processed in 112us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906781.896952:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787906781.896979:0:7984:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787906781.896990:0:7984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7984:1874756000305920:0@lo:502: 00000040:00080000:0.0:1787906781.897008:0:7984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787906781.897055:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787906781.897068:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787906781.897075:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1c4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.897084:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1c4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906781.897093:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787906781.897096:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8aa51a4db800 from 5 10000000:01000000:0.0:1787906781.897099:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787906781.897121:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.897128:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.897137:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906781.897148:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000306048:0@lo:101: 00000100:00100000:0.0:1787906781.897170:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.897189:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507ed1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787906781.897200:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000306048 00000100:00100000:0.0:1787906781.897203:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000306048 00000100:00100000:0.0:1787906781.897219:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787906781.897224:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000306048:12345-0@lo:101: 00010000:00010000:0.0:1787906781.897232:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906781.897243:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa500030c00/0x72bb6cf063cad1d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad1cb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.897259:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa500030c00/0x72bb6cf063cad1d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad1cb expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.897278:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa500030c00/0x72bb6cf063cad1d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad1cb expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.897286:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030c00, rc 0) 00000100:00100000:0.0:1787906781.897310:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000306048:12345-0@lo:101: Request processed in 86us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906781.897316:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787906781.897339:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000306048:0@lo:101: 00010000:00010000:0.0:1787906781.897348:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.897355:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906781.897391:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000306176:0@lo:256: 00000100:00100000:0.0:1787906781.897415:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.897587:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507ed1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787906781.897604:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000306176 00000100:00100000:0.0:1787906781.897607:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000306176 00000100:00100000:0.0:1787906781.897622:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787906781.897627:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000306176:12345-0@lo:256: 20000000:01000000:0.0:1787906781.897650:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787906781.897666:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787906781.897669:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787906781.897737:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000306176:12345-0@lo:256: Request processed in 109us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906781.897743:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787906781.897767:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000306176:0@lo:256: 10000000:01000000:0.0:1787906781.897802:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787906781.897806:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.897832:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906781.897838:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787906781.897840:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787906781.897842:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787906781.897855:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.897861:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.897867:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906781.897886:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000306304:0@lo:101: 00000100:00100000:0.0:1787906781.897908:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.897920:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507ed1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787906781.897930:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000306304 00000100:00100000:0.0:1787906781.897933:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000306304 00000100:00100000:0.0:1787906781.897949:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787906781.897955:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000306304:12345-0@lo:101: 00010000:00010000:0.0:1787906781.897961:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906781.897968:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad1e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad1d9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.897981:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad1e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad1d9 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.897989:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad1e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad1d9 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.897995:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031600, rc 0) 00000100:00100000:0.0:1787906781.898020:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000306304:12345-0@lo:101: Request processed in 65us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906781.898024:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787906781.898049:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000306304:0@lo:101: 00010000:00010000:0.0:1787906781.898057:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1e0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906781.898064:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad1e0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906781.898110:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000306432:0@lo:501: 00000100:00100000:0.0:1787906781.898133:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.898144:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507ed1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787906781.898155:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000306432 00000100:00100000:0.0:1787906781.898158:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000306432 00000100:00100000:0.0:1787906781.898173:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787906781.898178:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000306432:12345-0@lo:501: 00000100:00100000:0.0:1787906781.898674:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000306432:12345-0@lo:501: Request processed in 493us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906781.898681:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787906781.898712:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000306432:0@lo:501: 00000100:00100000:0.0:1787906781.898736:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000306560:0@lo:503: 00000100:00100000:0.0:1787906781.898770:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.898786:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507ed1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787906781.898796:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000306560 00000100:00100000:0.0:1787906781.898799:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000306560 00000100:00100000:0.0:1787906781.898839:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787906781.898846:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000306560:12345-0@lo:503: 00000100:00100000:0.0:1787906781.899108:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000306560:12345-0@lo:503: Request processed in 262us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906781.899114:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787906781.899150:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000306560:0@lo:503: 00000100:00100000:2.0:1787906781.900266:0:7985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7985:1874756000306688:0@lo:502: 00000100:00100000:2.0:1787906781.900397:0:7985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906781.900545:0:7985:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510b85900 going to sleep for 11 seconds 00000100:00100000:0.0:1787906781.900663:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000306688 00000100:00100000:0.0:1787906781.900671:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000306688 00000100:00100000:0.0:1787906781.900720:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787906781.900730:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:7985:x1874756000306688:12345-0@lo:502: 00000100:00100000:0.0:1787906781.901038:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:7985:x1874756000306688:12345-0@lo:502: Request processed in 309us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906781.901045:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787906781.901101:0:7985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7985:1874756000306688:0@lo:502: 00000020:01000000:0.0:1787906781.901132:0:7985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787906781.901140:0:7985:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787906781.901148:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787906781.901151:0:7985:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787906781.901171:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787906781.901175:0:7985:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:0.0:1787906781.901199:0:7985:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787906781.901201:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787906781.901216:0:7985:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8aa510bd4d28) 00000020:00000080:0.0:1787906781.901238:0:7985:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787906781.901243:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787906781.901323:0:7985:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787906781.901330:0:7985:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787906781.901336:0:7985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bb6cf063cad1ee 00010000:00080000:0.0:1787906781.901365:0:7985:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa510325800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1787906781.901708:0:7985:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787906781.902054:0:7985:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787906781.902071:0:7985:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787906781.902987:0:7985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787906781.903216:0:7985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787906781.903267:0:7985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787906781.903581:0:7985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787906781.914524:0:7987:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787906781.914536:0:7987:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787906781.922878:0:7985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787906781.922903:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787906781.922946:0:7985:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787906781.922971:0:7985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bb6cf063cad1f5 00000100:00080000:2.0:1787906781.922984:0:7985:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787906781.922992:0:7985:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8aa510325800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1787906781.923030:0:7985:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa541c1df80 x1874756000306816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787906781.923054:0:7985:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787906781.923105:0:7985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787906781.923109:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906781.923111:0:7985:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787906781.923114:0:7985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787906781.923118:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906781.923121:0:7985:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787906781.923123:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787906781.923125:0:7985:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787906781.924312:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000306816:0@lo:8: 00000100:00100000:3.0:1787906781.924392:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906781.924650:0:7985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7985:1874756000306944:0@lo:502: 00000100:00100000:2.0:1787906781.924674:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000306816 00000100:00100000:2.0:1787906781.924681:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000306816 00000100:00100000:2.0:1787906781.924722:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787906781.924730:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3300:x1874756000306816:12345-0@lo:8: 00010000:00080000:2.0:1787906781.924756:0:6675:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:2.0:1787906781.924783:0:6675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bb6cf063cad1fc 00002000:00100000:2.0:1787906781.924799:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8aa53b054000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113955 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787906781.924803:0:6675:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787906781.924807:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787906781.924949:0:6675:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787906781.925107:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787906781.925136:0:6675:0:(import.c:65:import_set_state_nolock()) ffff8aa53b057000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787906781.925208:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1874756000306816:12345-0@lo:8: Request processed in 477us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906781.925215:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787906781.925256:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa541c1df80 x1874756000306816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787906791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906781.925266:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1787906781.927767:0:7985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906781.927831:0:7985:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5073f90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787906781.929417:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000307072:0@lo:400: 00000100:00100000:0.0:1787906781.929545:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.929604:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787906781.929612:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000307200:0@lo:400: 00000100:00100000:0.0:1787906781.929647:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.929686:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000307328:0@lo:400: 00000100:00100000:0.0:1787906781.929715:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.929740:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787906781.929746:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000307456:0@lo:400: 00000100:00100000:0.0:1787906781.929767:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906781.929802:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000306944 00000100:00100000:0.0:1787906781.929826:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000306944 00000100:00100000:0.0:1787906781.929882:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787906781.929891:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:7985:x1874756000306944:12345-0@lo:502: 00000100:00100000:3.0:1787906781.930281:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000307072 00000100:00100000:3.0:1787906781.930286:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000307072 00000100:00100000:3.0:1787906781.930313:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000307200 00000100:00100000:3.0:1787906781.930317:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000307200 00000100:00100000:3.0:1787906781.930339:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000307456 00000100:00100000:3.0:1787906781.930342:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000307456 00000100:00100000:3.0:1787906781.930359:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787906781.930366:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000307072:12345-0@lo:400: 00000100:00100000:3.0:1787906781.930413:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000307072:12345-0@lo:400: Request processed in 47us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906781.930420:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787906781.930435:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787906781.930441:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000307200:12345-0@lo:400: 00000100:00100000:3.0:1787906781.930467:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000307200:12345-0@lo:400: Request processed in 27us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906781.930473:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787906781.930606:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787906781.930614:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa51032ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000307456:12345-0@lo:400: 00000100:00100000:3.0:1787906781.930661:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa51032ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000307456:12345-0@lo:400: Request processed in 48us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906781.930668:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787906781.931345:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000307328 00000100:00100000:3.0:1787906781.931353:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000307328 00000100:00100000:3.0:1787906781.931399:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787906781.931407:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000307328:12345-0@lo:400: 00000100:00100000:3.0:1787906781.931449:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000307328:12345-0@lo:400: Request processed in 43us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906781.931466:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787906781.931611:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787906781.931622:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787906781.931628:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787906781.931642:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa510325800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787906781.931664:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787906781.931673:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000306816:0@lo:8: 00000100:00100000:0.0:1787906781.933262:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:7985:x1874756000306944:12345-0@lo:502: Request processed in 3366us (5494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906781.933340:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1787906781.933403:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787906781.933410:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787906781.933458:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa51032b100 x1874756000307200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906781.934250:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000307200:0@lo:400: 00010000:00080000:1.0:1787906781.935092:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510328e00 x1874756000307456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906781.935119:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000307456:0@lo:400: 00010000:00080000:1.0:1787906781.935134:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510328700 x1874756000307328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906781.935143:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000307328:0@lo:400: 00000004:00080000:1.0:1787906781.935177:0:7987:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:0.0:1787906781.935252:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510329880 x1874756000307072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906781.935263:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000307072:0@lo:400: 00000004:00080000:1.0:1787906781.935385:0:7987:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 220207571713ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787906781.935593:0:7985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:7985:1874756000306944:0@lo:502: 00000020:01000000:3.0:1787906781.935644:0:7985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787906781.935652:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787906781.935654:0:7985:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787906781.935658:0:7985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1787906781.938030:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787906781.938317:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787906781.938330:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1e0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906781.938343:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1e0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787906781.938365:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787906781.938368:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8aa510bd0000 from 1 10000000:01000000:1.0:1787906781.938371:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787906781.938876:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906781.938885:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906781.938897:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906781.939222:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000307584:0@lo:101: 00000100:00100000:1.0:1787906781.939399:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906781.939565:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000307584 00000100:00100000:3.0:1787906781.939573:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000307584 00000100:00100000:1.0:1787906781.939613:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787906781.939617:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787906781.939627:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000307584:12345-0@lo:101: 00010000:00010000:3.0:1787906781.939651:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906781.939665:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad20a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad203 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906781.939695:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad20a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad203 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906781.939705:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad20a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad203 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906781.939713:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511995600, rc 0) 00000100:00100000:3.0:1787906781.939761:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000307584:12345-0@lo:101: Request processed in 135us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906781.939766:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787906781.939896:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000307584:0@lo:101: 00010000:00010000:1.0:1787906781.939910:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad20a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906781.939932:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad20a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906781.939988:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000307712:0@lo:501: 00000100:00100000:1.0:1787906781.940013:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906781.940035:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787906781.940916:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000307712 00000100:00100000:1.0:1787906781.940934:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000307712 00000100:00100000:1.0:1787906781.940970:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787906781.940986:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000307712:12345-0@lo:501: 00000100:00100000:1.0:1787906781.941706:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000307712:12345-0@lo:501: Request processed in 719us (1689us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787906781.941715:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787906781.941760:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000307712:0@lo:501: 10000000:01000000:1.0:1787906781.942002:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787906781.942012:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad20a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906781.942022:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad20a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787906782.028754:0:7989:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787906782.028787:0:7989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520affb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874756000307968:0@lo:7: 00000100:00100000:1.0:1787906782.031348:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000307840:0@lo:13: 00000100:00100000:1.0:1787906782.031412:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906782.031563:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000307840 00000100:00100000:1.0:1787906782.031571:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000307840 00000100:00100000:1.0:1787906782.031802:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787906782.031830:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874756000307840:12345-0@lo:13: 00002000:00000024:1.0:1787906782.031865:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787906782.031913:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874756000307840:12345-0@lo:13: Request processed in 102us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906782.031921:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787906782.031941:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787906782.031970:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa520afc000 x1874756000307840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906782.031996:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000307840:0@lo:13: 00000100:00100000:1.0:1787906782.032049:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906782.032067:0:7989:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787906782.032080:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000307968 00000100:00100000:1.0:1787906782.032084:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000307968 00000100:00100000:1.0:1787906782.032109:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787906782.032116:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7989:x1874756000307968:12345-0@lo:7: 00002000:00080000:1.0:1787906782.045832:0:6674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787906782.045841:0:6674:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787906782.045938:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7989:x1874756000307968:12345-0@lo:7: Request processed in 13817us (13883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906782.045949:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787906782.046430:0:7989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa520affb80 x1874756000307968/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787906798 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906782.046447:0:7989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520affb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874756000307968:0@lo:7: 00000004:00080000:1.0:1787906782.046461:0:7989:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787906782.046500:0:7989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520affb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874756000308096:0@lo:5: 00000100:00100000:1.0:1787906782.046543:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906782.046599:0:7989:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787906782.046615:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000308096 00000100:00100000:1.0:1787906782.046622:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000308096 00000100:00100000:1.0:1787906782.046676:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787906782.046686:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7989:x1874756000308096:12345-0@lo:5: 00002000:00080000:1.0:1787906782.046714:0:6675:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787906782.046718:0:6675:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787906782.047016:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7989:x1874756000308096:12345-0@lo:5: Request processed in 332us (473us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787906782.047034:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787906782.047066:0:7989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa520affb80 x1874756000308096/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787906798 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906782.047079:0:7989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520affb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874756000308096:0@lo:5: 00000004:00080000:1.0:1787906782.047088:0:7989:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787906782.047124:0:7989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510211180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874756000308224:0@lo:700: 00000100:00100000:1.0:1787906782.047148:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906782.047165:0:7989:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787906782.047178:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000308224 00000100:00100000:1.0:1787906782.047181:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000308224 00000100:00100000:1.0:1787906782.047207:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787906782.047214:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7989:x1874756000308224:12345-0@lo:700: 00000100:00100000:1.0:1787906782.047239:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6681:1874756000308352:0@lo:700: 00000100:00100000:1.0:1787906782.047264:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906782.047280:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4840 going to sleep for 11 seconds 00000100:00100000:1.0:1787906782.048410:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000308352 00000100:00100000:1.0:1787906782.048421:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000308352 00000100:00100000:1.0:1787906782.048475:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787906782.048484:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6681:x1874756000308352:12345-0@lo:700: 00000004:00080000:1.0:1787906782.136909:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1787906782.219603:0:5837:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787906782.235435:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6681:x1874756000308352:12345-0@lo:700: Request processed in 186921us (188138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906782.235480:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787906782.236112:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510213100 x1874756000308352/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787906798 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906782.236138:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6681:1874756000308352:0@lo:700: 40000000:02000000:3.0:1787906782.236184:0:6681:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1787906782.356706:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787906782.356741:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787906782.356908:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7989:x1874756000308224:12345-0@lo:700: Request processed in 309592us (309656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906782.356930:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787906782.357294:0:7989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510211180 x1874756000308224/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787906798 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906782.357316:0:7989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510211180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874756000308224:0@lo:700: 00000004:02000040:0.0:1787906782.438686:0:7989:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787906782.448740:0:7989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510211c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874756000308480:0@lo:5: 00000100:00100000:1.0:1787906782.448878:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906782.448967:0:7989:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787906782.449094:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000308480 00000100:00100000:0.0:1787906782.449107:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000308480 00000100:00100000:0.0:1787906782.449194:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787906782.449206:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7989:x1874756000308480:12345-0@lo:5: 00002000:00080000:1.0:1787906782.467281:0:6674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787906782.467313:0:6674:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787906782.483143:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7989:x1874756000308480:12345-0@lo:5: Request processed in 33925us (34253us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787906782.484232:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787906782.484718:0:7989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510211c00 x1874756000308480/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787906798 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906782.484736:0:7989:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787906782.484762:0:7989:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8aa510211c00 x1874756000308480/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787906798 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906782.484774:0:7989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510211c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874756000308480:0@lo:5: 00000004:00080000:3.0:1787906782.484792:0:7989:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1787906782.885921:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906783.908841:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906784.928304:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906784.928538:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000308608:0@lo:13: 00000100:00100000:1.0:1787906784.928687:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906784.928950:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000308608 00000100:00100000:3.0:1787906784.928962:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000308608 00000100:00100000:3.0:1787906784.929039:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787906784.929053:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000308608:12345-0@lo:13: 00002000:00000024:3.0:1787906784.929172:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906784.929239:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000308608:12345-0@lo:13: Request processed in 190us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906784.929249:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787906784.929320:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787906784.929361:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510329880 x1874756000308608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906784.929392:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000308608:0@lo:13: 00010000:00010000:3.0:1787906785.954014:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906786.978571:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000308992:0@lo:400: 00000100:00100000:2.0:1787906786.978613:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000308864:0@lo:400: 00000100:00100000:1.0:1787906786.978714:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000308736:0@lo:400: 00010000:00010000:0.0:1787906786.978837:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906786.982404:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906786.982651:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000308736 00000100:00100000:0.0:1787906786.982666:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000308736 00000100:00100000:0.0:1787906786.982747:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787906786.982760:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000308736:12345-0@lo:400: 00000100:00100000:0.0:1787906786.982877:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000308736:12345-0@lo:400: Request processed in 119us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906786.982885:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787906786.982954:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000308736:0@lo:400: 00000100:00100000:2.0:1787906786.983687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906786.983932:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000308864 00000100:00100000:1.0:1787906786.983943:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000308864 00000100:00100000:1.0:1787906786.984003:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787906786.984015:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000308864:12345-0@lo:400: 00000100:00100000:1.0:1787906786.984109:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000308864:12345-0@lo:400: Request processed in 97us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906786.984116:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787906786.984230:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa503052a00 x1874756000308864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906786.984248:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000308864:0@lo:400: 00000100:00100000:3.0:1787906786.984301:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906786.984351:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000308992 00000100:00100000:0.0:1787906786.984357:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000308992 00000100:00100000:3.0:1787906786.984428:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787906786.984441:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787906786.984451:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000308992:12345-0@lo:400: 00000100:00100000:3.0:1787906786.984456:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000309120:0@lo:400: 00000100:00100000:0.0:1787906786.984504:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000308992:12345-0@lo:400: Request processed in 54us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906786.984511:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787906786.984523:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787906786.984572:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa503053b80 x1874756000308992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906786.984583:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000308992:0@lo:400: 00000100:00100000:3.0:1787906786.984611:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000309120 00000100:00100000:3.0:1787906786.984615:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000309120 00000100:00100000:3.0:1787906786.984667:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787906786.984677:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000309120:12345-0@lo:400: 00000100:00100000:3.0:1787906786.984735:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000309120:12345-0@lo:400: Request processed in 60us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906786.984742:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787906786.984772:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa503051500 x1874756000309120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906786.984784:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000309120:0@lo:400: 00000100:00100000:0.0:1787906786.984992:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000309376:0@lo:400: 00000100:00100000:0.0:1787906786.985025:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906786.985052:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787906786.985059:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000309248:0@lo:400: 00000100:00100000:0.0:1787906786.985083:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906786.985112:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000309248 00000100:00100000:0.0:1787906786.985115:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000309248 00000100:00100000:0.0:1787906786.985142:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787906786.985148:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa51032a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000309248:12345-0@lo:400: 00000100:00100000:0.0:1787906786.985185:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa51032a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000309248:12345-0@lo:400: Request processed in 37us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906786.985191:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787906786.985218:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa503051500 x1874756000309248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787906802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906786.985229:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000309248:0@lo:400: 00000100:00080000:1.0:1787906786.985385:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787906786.985392:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906786.986181:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000309376 00000100:00100000:3.0:1787906786.986192:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000309376 00000100:00100000:3.0:1787906786.986305:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787906786.986316:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa51032b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874756000309376:12345-0@lo:400: 00000100:00100000:3.0:1787906786.986395:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa51032b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874756000309376:12345-0@lo:400: Request processed in 82us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906786.986403:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787906786.986871:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa503053b80 x1874756000309376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906786.986887:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000309376:0@lo:400: 00000100:00080000:1.0:1787906786.987371:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787906787.501867:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787906787.501898:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000309504:0@lo:13: 00000100:00100000:1.0:1787906787.501972:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906787.502042:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000309504 00000100:00100000:1.0:1787906787.502051:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000309504 00000100:00100000:1.0:1787906787.502110:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787906787.502118:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874756000309504:12345-0@lo:13: 00002000:00000024:1.0:1787906787.502166:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906787.502225:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874756000309504:12345-0@lo:13: Request processed in 106us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906787.502232:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787906787.502272:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa503052d80 x1874756000309504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906787.502292:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000309504:0@lo:13: 00000001:00080000:1.0:1787906787.682762:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1787906787.999934:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906788.895848:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906788.896407:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971973248 00000100:00100000:3.0:1787906788.896433:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971973248 00000100:00100000:3.0:1787906788.896529:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 113 00000100:00100000:3.0:1787906788.896542:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2342:x1874755971973248:12345-192.168.204.20@tcp:250: 00010000:00080000:3.0:1787906788.896698:0:5823:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9eec00eb-d19d-4892-ad44-299469e66291@192.168.204.20@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1787906788.896748:0:5823:0:(genops.c:1385:class_connect()) connect: client 9eec00eb-d19d-4892-ad44-299469e66291, cookie 0x72bb6cf063cad211 00000100:00080000:3.0:1787906788.897460:0:5823:0:(import.c:65:import_set_state_nolock()) ffff8aa5170c4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787906788.898709:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+5:2342:x1874755971973248:12345-192.168.204.20@tcp:250: Request processed in 2159us (2908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906788.898723:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 113 00000100:00100000:0.0:1787906788.905541:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906788.905790:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971973376 00000100:00100000:1.0:1787906788.905804:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971973376 00000100:00100000:1.0:1787906788.905915:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:1.0:1787906788.905930:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+5:5575:x1874755971973376:12345-192.168.204.20@tcp:101: 00010000:00010000:1.0:1787906788.905953:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906788.905985:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa508211200/0x72bb6cf063cad218 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef4f1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906788.906029:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508211200/0x72bb6cf063cad218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f1 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906788.906044:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa508211200/0x72bb6cf063cad218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f1 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906788.906057:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211200, rc 0) 00000100:00100000:1.0:1787906788.906149:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+6:5575:x1874755971973376:12345-192.168.204.20@tcp:101: Request processed in 222us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906788.906183:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:0.0:1787906788.913172:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906788.913542:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971973504 00000100:00100000:3.0:1787906788.913559:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971973504 00000100:00100000:3.0:1787906788.913643:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:3.0:1787906788.913661:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+6:5575:x1874755971973504:12345-192.168.204.20@tcp:501: 00000100:00100000:3.0:1787906788.914032:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+6:5575:x1874755971973504:12345-192.168.204.20@tcp:501: Request processed in 374us (875us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787906788.914041:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:1.0:1787906788.920615:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906788.920806:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971973632 00000100:00100000:3.0:1787906788.920846:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971973632 00000100:00100000:3.0:1787906788.920917:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:3.0:1787906788.920929:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+6:5575:x1874755971973632:12345-192.168.204.20@tcp:101: 00010000:00010000:3.0:1787906788.920954:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906788.920978:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511994e00/0x72bb6cf063cad21f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef4f8 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906788.921013:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511994e00/0x72bb6cf063cad21f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f8 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906788.921027:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511994e00/0x72bb6cf063cad21f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f8 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906788.921060:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511994e00, rc 0) 00000100:00100000:3.0:1787906788.921140:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+7:5575:x1874755971973632:12345-192.168.204.20@tcp:101: Request processed in 211us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906788.921147:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:0.0:1787906788.924771:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906788.924909:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971973760 00000100:00100000:3.0:1787906788.924923:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971973760 00000100:00100000:3.0:1787906788.925033:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:3.0:1787906788.925046:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+7:5575:x1874755971973760:12345-192.168.204.20@tcp:501: 00000100:00100000:3.0:1787906788.925458:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+8:5575:x1874755971973760:12345-192.168.204.20@tcp:501: Request processed in 413us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906788.925468:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:3.0:1787906788.929583:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906788.930115:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971973888 00000100:00100000:1.0:1787906788.930135:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971973888 00000100:00100000:1.0:1787906788.930283:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:1.0:1787906788.930314:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+8:5575:x1874755971973888:12345-192.168.204.20@tcp:503: 00000100:00100000:1.0:1787906788.930763:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+8:5575:x1874755971973888:12345-192.168.204.20@tcp:503: Request processed in 449us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906788.930774:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:1.0:1787906788.937058:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906788.937268:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971974016 00000100:00100000:3.0:1787906788.937285:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971974016 00000100:00100000:3.0:1787906788.937383:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:3.0:1787906788.938208:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+8:5594:x1874755971974016:12345-192.168.204.20@tcp:502: 00000100:00100000:3.0:1787906788.940419:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+8:5594:x1874755971974016:12345-192.168.204.20@tcp:502: Request processed in 2994us (3351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906788.940438:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:2.0:1787906788.971619:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906788.971729:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971974144 00000100:00100000:1.0:1787906788.971748:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971974144 00000100:00100000:1.0:1787906788.971891:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:1.0:1787906788.971906:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+8:5594:x1874755971974144:12345-192.168.204.20@tcp:502: 00000100:00100000:1.0:1787906788.972317:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+8:5594:x1874755971974144:12345-192.168.204.20@tcp:502: Request processed in 411us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906788.972327:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:1.0:1787906788.980577:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906788.980707:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971974272 00000100:00100000:3.0:1787906788.980722:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971974272 00000100:00100000:3.0:1787906788.980803:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:3.0:1787906788.987610:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+8:5575:x1874755971974272:12345-192.168.204.20@tcp:101: 00010000:00010000:3.0:1787906788.987643:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906788.987680:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511994800/0x72bb6cf063cad226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef522 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906788.987720:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511994800/0x72bb6cf063cad226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef522 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906788.987733:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511994800/0x72bb6cf063cad226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef522 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906788.987744:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511994800, rc 0) 00000100:00100000:3.0:1787906788.987844:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+9:5575:x1874755971974272:12345-192.168.204.20@tcp:101: Request processed in 7029us (7283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906788.987853:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:2.0:1787906788.994549:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906788.994662:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971974400 00000100:00100000:3.0:1787906788.994678:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971974400 00000100:00100000:3.0:1787906788.994750:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:3.0:1787906788.994761:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+9:5575:x1874755971974400:12345-192.168.204.20@tcp:256: 20000000:01000000:3.0:1787906788.994800:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787906788.994855:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787906788.994861:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787906788.994864:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787906788.994867:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787906789.008437:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+9:5575:x1874755971974400:12345-192.168.204.20@tcp:256: Request processed in 13648us (13882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906789.008461:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:1.0:1787906789.019859:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906789.019978:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971974528 00000100:00100000:3.0:1787906789.019993:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971974528 00000100:00100000:3.0:1787906789.020284:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:3.0:1787906789.020299:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+9:5575:x1874755971974528:12345-192.168.204.20@tcp:101: 00010000:00010000:3.0:1787906789.020345:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906789.020372:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511995800/0x72bb6cf063cad22d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef529 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906789.020413:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511995800/0x72bb6cf063cad22d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef529 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906789.020427:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511995800/0x72bb6cf063cad22d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef529 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906789.020438:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511995800, rc 0) 00000100:00100000:3.0:1787906789.020536:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+10:5575:x1874755971974528:12345-192.168.204.20@tcp:101: Request processed in 241us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906789.020544:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:0.0:1787906789.027341:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1787906789.027419:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906789.027503:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971974656 00000100:00100000:3.0:1787906789.027520:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971974656 00000100:00100000:3.0:1787906789.027629:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:3.0:1787906789.027645:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:5575:x1874755971974656:12345-192.168.204.20@tcp:501: 00000100:00100000:3.0:1787906789.028317:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:5575:x1874755971974656:12345-192.168.204.20@tcp:501: Request processed in 672us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906789.028330:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:0.0:1787906789.037121:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906789.037318:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971974784 00000100:00100000:2.0:1787906789.037332:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971974784 00000100:00100000:2.0:1787906789.037396:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:2.0:1787906789.037407:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+10:5575:x1874755971974784:12345-192.168.204.20@tcp:503: 00000100:00100000:2.0:1787906789.037903:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+10:5575:x1874755971974784:12345-192.168.204.20@tcp:503: Request processed in 495us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906789.037913:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:2.0:1787906789.042459:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906789.042543:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971974912 00000100:00100000:3.0:1787906789.042557:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971974912 00000100:00100000:3.0:1787906789.042621:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:3.0:1787906789.042633:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:5598:x1874755971974912:12345-192.168.204.20@tcp:502: 00000100:00100000:3.0:1787906789.042987:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:5598:x1874755971974912:12345-192.168.204.20@tcp:502: Request processed in 354us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906789.043006:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:0.0:1787906789.046257:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906789.046349:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971975040 00000100:00100000:2.0:1787906789.046365:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971975040 00000100:00100000:2.0:1787906789.046524:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 127 00000100:00100000:2.0:1787906789.046541:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:5598:x1874755971975040:12345-192.168.204.20@tcp:502: 00000100:00100000:2.0:1787906789.046924:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:5598:x1874755971975040:12345-192.168.204.20@tcp:502: Request processed in 386us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906789.046935:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 127 00000100:00100000:3.0:1787906789.053852:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906789.053970:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971975168 00000100:00100000:0.0:1787906789.053986:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971975168 00000100:00100000:0.0:1787906789.054083:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:0.0:1787906789.054096:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2342:x1874755971975168:12345-192.168.204.20@tcp:38: 00010000:00080000:0.0:1787906789.054141:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:0.0:1787906789.054218:0:5831:0:(genops.c:1385:class_connect()) connect: client 419aebcc-abec-417c-9cd3-22c347ab3c27, cookie 0x72bb6cf063cad234 00000004:00100000:0.0:1787906789.054267:0:5831:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787906789.054274:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787906789.129670:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8aa510321800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787906789.130018:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2342:x1874755971975168:12345-192.168.204.20@tcp:38: Request processed in 75920us (76208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906789.130033:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:2.0:1787906790.048523:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000309632:0@lo:13: 00000100:00100000:2.0:1787906790.048633:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787906790.049645:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906790.053867:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000309632 00000100:00100000:0.0:1787906790.053890:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000309632 00000100:00100000:0.0:1787906790.054105:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787906790.054125:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000309632:12345-0@lo:13: 00002000:00000024:0.0:1787906790.054342:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906790.054470:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000309632:12345-0@lo:13: Request processed in 352us (5838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906790.054491:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787906790.054572:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787906790.055421:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa51032a300 x1874756000309632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906790.055471:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000309632:0@lo:13: 00000100:00100000:0.0:1787906790.141696:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906790.141753:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906790.141853:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971975424 00000100:00100000:2.0:1787906790.141878:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971975424 00000100:00100000:2.0:1787906790.141980:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971975296 00000100:00100000:2.0:1787906790.141984:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971975296 00000100:00100000:2.0:1787906790.142004:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:2.0:1787906790.142016:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa51032b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+7:5575:x1874755971975424:12345-192.168.204.20@tcp:41: 00000004:00000024:2.0:1787906790.142092:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787906790.142195:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa51032b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+7:5575:x1874755971975424:12345-192.168.204.20@tcp:41: Request processed in 180us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906790.142205:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:2.0:1787906790.142231:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:2.0:1787906790.142238:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa51032a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:0:x1874755971975296:12345-192.168.204.20@tcp:41: 00000004:00000024:2.0:1787906790.142249:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787906790.142268:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa51032a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:0:x1874755971975296:12345-192.168.204.20@tcp:41: Request processed in 31us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906790.142274:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00080000:1.0:1787906790.142517:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906790.146504:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906790.146623:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971975552 00000100:00100000:0.0:1787906790.146656:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971975552 00000100:00100000:0.0:1787906790.146734:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:0.0:1787906790.146746:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:5575:x1874755971975552:12345-192.168.204.20@tcp:40: 00000100:00100000:0.0:1787906790.147147:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:5575:x1874755971975552:12345-192.168.204.20@tcp:40: Request processed in 401us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906790.147156:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:2.0:1787906790.161722:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906790.162050:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906790.164550:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971975680 00000100:00100000:3.0:1787906790.164563:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971975808 00000100:00100000:3.0:1787906790.164573:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971975808 00000100:00100000:0.0:1787906790.164573:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971975680 00000100:00100000:2.0:1787906790.164739:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906790.165291:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906790.165330:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971976064 00000100:00100000:2.0:1787906790.165464:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971976064 00000100:00100000:2.0:1787906790.165544:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 128 00000100:00100000:2.0:1787906790.165559:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+10:2345:x1874755971976064:12345-192.168.204.20@tcp:400: 00000100:00100000:2.0:1787906790.165670:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+10:2345:x1874755971976064:12345-192.168.204.20@tcp:400: Request processed in 115us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906790.165681:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 128 00000100:00100000:0.0:1787906790.166209:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:0.0:1787906790.166220:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2342:x1874755971975680:12345-192.168.204.20@tcp:8: 00010000:00080000:0.0:1787906790.166260:0:6675:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:0.0:1787906790.166308:0:6675:0:(genops.c:1385:class_connect()) connect: client 419aebcc-abec-417c-9cd3-22c347ab3c27, cookie 0x72bb6cf063cad23b 00002000:00100000:0.0:1787906790.166327:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 419aebcc-abec-417c-9cd3-22c347ab3c27/ffff8aa510321000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787906790.166356:0:6675:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787906790.166661:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971975936 00000100:00100000:1.0:1787906790.166673:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971975936 00000100:00100000:1.0:1787906790.167146:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:1.0:1787906790.167161:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:5575:x1874755971975936:12345-192.168.204.20@tcp:33: 00002000:00080000:0.0:1787906790.167730:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787906790.167781:0:6675:0:(import.c:65:import_set_state_nolock()) ffff8aa510325000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787906790.170924:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2342:x1874755971975680:12345-192.168.204.20@tcp:8: Request processed in 4675us (9197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906790.170942:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:0.0:1787906790.171003:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:0.0:1787906790.171022:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2342:x1874755971975808:12345-192.168.204.20@tcp:8: 00010000:00080000:0.0:1787906790.171066:0:6675:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:0.0:1787906790.171112:0:6675:0:(genops.c:1385:class_connect()) connect: client 419aebcc-abec-417c-9cd3-22c347ab3c27, cookie 0x72bb6cf063cad242 00002000:00100000:0.0:1787906790.171130:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 419aebcc-abec-417c-9cd3-22c347ab3c27/ffff8aa510326000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787906790.171185:0:6675:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787906790.172001:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787906790.172252:0:6675:0:(import.c:65:import_set_state_nolock()) ffff8aa510327800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787906790.172331:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2342:x1874755971975808:12345-192.168.204.20@tcp:8: Request processed in 1317us (10280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906790.172342:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000004:00080000:3.0:1787906790.214437:0:5833:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 47191us 00000004:00200000:2.0:1787906790.254428:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787906790.254744:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:5575:x1874755971975936:12345-192.168.204.20@tcp:33: Request processed in 87575us (90004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906790.254769:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:2.0:1787906790.516099:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906790.516857:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971976192 00000100:00100000:3.0:1787906790.516874:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971976192 00000100:00100000:3.0:1787906790.517081:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:3.0:1787906790.517097:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:5616:x1874755971976192:12345-192.168.204.20@tcp:101: 00010000:00010000:3.0:1787906790.517125:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906790.518275:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cad249 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef553 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906790.518378:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad250 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906790.518400:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906790.518434:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906790.518719:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787906790.518724:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906790.518997:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906790.519034:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cad249 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef553 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906790.519056:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad250 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef553 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906790.519064:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:3.0:1787906790.519067:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787906790.519070:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511995000, rc 0) 00000100:00100000:3.0:1787906790.519162:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:5616:x1874755971976192:12345-192.168.204.20@tcp:101: Request processed in 2067us (3080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906790.519172:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00010000:00010000:0.0:1787906791.085226:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787906791.139724:0:6699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 419aebcc-abec-417c-9cd3-22c347ab3c27 00000100:00100000:3.0:1787906792.098487:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000310016:0@lo:400: 00000100:00100000:3.0:1787906792.098599:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906792.098709:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787906792.098726:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000310144:0@lo:400: 00000100:00100000:3.0:1787906792.098764:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787906792.098841:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906792.099276:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000309888:0@lo:400: 00000100:00100000:2.0:1787906792.099319:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906792.099361:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000310400:0@lo:400: 00000100:00100000:2.0:1787906792.099387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906792.099448:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787906792.099456:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000309760:0@lo:400: 00000100:00100000:2.0:1787906792.099497:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906792.099525:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000310272:0@lo:400: 00000100:00100000:2.0:1787906792.099590:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906792.099636:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000309760 00000100:00100000:2.0:1787906792.099649:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000309760 00000100:00100000:2.0:1787906792.099733:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787906792.099746:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000309760:12345-0@lo:400: 00000100:00100000:2.0:1787906792.099857:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000309760:12345-0@lo:400: Request processed in 113us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906792.099866:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787906792.099935:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000309760:0@lo:400: 00000100:00100000:1.0:1787906792.100386:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000310144 00000100:00100000:1.0:1787906792.100394:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000310144 00000100:00100000:1.0:1787906792.100480:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000310400 00000100:00100000:1.0:1787906792.100485:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000310400 00000100:00100000:1.0:1787906792.100508:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787906792.100516:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000310144:12345-0@lo:400: 00000100:00100000:1.0:1787906792.100597:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000310144:12345-0@lo:400: Request processed in 83us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906792.100605:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787906792.100619:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787906792.100625:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000310400:12345-0@lo:400: 00000100:00100000:1.0:1787906792.100669:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000310400:12345-0@lo:400: Request processed in 44us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906792.100675:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787906792.100736:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe2d80 x1874756000310144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906792.100753:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000310144:0@lo:400: 00000100:00080000:2.0:1787906792.100996:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787906792.101000:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787906792.101024:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe0700 x1874756000310400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906792.101034:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787906792.101051:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000310400:0@lo:400: 00000100:00100000:0.0:1787906792.102757:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000310016 00000100:00100000:0.0:1787906792.102775:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000310016 00000100:00100000:0.0:1787906792.102877:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000309888 00000100:00100000:0.0:1787906792.102881:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000309888 00000100:00100000:0.0:1787906792.102897:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000310272 00000100:00100000:0.0:1787906792.102900:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000310272 00000100:00100000:0.0:1787906792.102923:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787906792.102933:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000310016:12345-0@lo:400: 00000100:00100000:0.0:1787906792.103049:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000310016:12345-0@lo:400: Request processed in 118us (4450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906792.103057:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787906792.103074:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787906792.103081:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000309888:12345-0@lo:400: 00000100:00100000:0.0:1787906792.103123:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000309888:12345-0@lo:400: Request processed in 43us (3803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906792.103128:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787906792.103138:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787906792.103145:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000310272:12345-0@lo:400: 00000100:00100000:0.0:1787906792.103172:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000310272:12345-0@lo:400: Request processed in 28us (3582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906792.103202:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787906792.103267:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000310272:0@lo:400: 00000100:00100000:0.0:1787906792.103284:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000309888:0@lo:400: 00000100:00080000:2.0:1787906792.104191:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906792.104305:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000310016:0@lo:400: 00000100:00100000:0.0:1787906792.608296:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787906792.611001:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000310528:0@lo:13: 00000100:00100000:0.0:1787906792.613603:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906792.623033:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000310528 00000100:00100000:1.0:1787906792.623059:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000310528 00000100:00100000:1.0:1787906792.623170:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787906792.623184:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000310528:12345-0@lo:13: 00002000:00000024:1.0:1787906792.623246:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906792.623394:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000310528:12345-0@lo:13: Request processed in 213us (9806us total) trans 0 rc 0/0 00010000:00080000:0.0:1787906792.623990:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe1c00 x1874756000310528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906792.624025:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000310528:0@lo:13: 00000100:00100000:1.0:1787906792.624126:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787906792.750160:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906792.753759:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971976320 00000100:00100000:0.0:1787906792.753775:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971976320 00000100:00100000:0.0:1787906792.753899:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:0.0:1787906792.753911:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+7:5668:x1874755971976320:12345-192.168.204.20@tcp:41: 00000004:00000024:0.0:1787906792.753966:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787906792.754058:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+7:5668:x1874755971976320:12345-192.168.204.20@tcp:41: Request processed in 149us (3910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906792.754076:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00080000:2.0:1787906792.756037:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906792.763960:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906792.764080:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971976448 00000100:00100000:1.0:1787906792.764098:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971976448 00000100:00100000:1.0:1787906792.764218:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:1.0:1787906792.764232:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:419aebcc-abec-417c-9cd3-22c347ab3c27+5:5668:x1874755971976448:12345-192.168.204.20@tcp:13: 00002000:00000024:1.0:1787906792.764304:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906792.764407:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:419aebcc-abec-417c-9cd3-22c347ab3c27+5:5668:x1874755971976448:12345-192.168.204.20@tcp:13: Request processed in 178us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906792.764416:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00080000:2.0:1787906792.766681:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787906792.771182:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906792.771527:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971976576 00000100:00100000:2.0:1787906792.771545:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971976576 00000100:00100000:2.0:1787906792.771653:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1787906792.771666:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:419aebcc-abec-417c-9cd3-22c347ab3c27+6:5668:x1874755971976576:12345-192.168.204.20@tcp:13: 00002000:00000024:2.0:1787906792.771705:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906792.771801:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:419aebcc-abec-417c-9cd3-22c347ab3c27+6:5668:x1874755971976576:12345-192.168.204.20@tcp:13: Request processed in 137us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906792.771850:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00080000:1.0:1787906792.772052:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787906793.123302:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906794.145389:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787906794.265108:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 419aebcc-abec-417c-9cd3-22c347ab3c27 00000001:00100000:2.0:1787906794.703532:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 419aebcc-abec-417c-9cd3-22c347ab3c27 00010000:00010000:1.0:1787906795.169723:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906795.170669:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000310656:0@lo:13: 00000100:00100000:3.0:1787906795.170742:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906795.170959:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000310656 00000100:00100000:0.0:1787906795.170970:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000310656 00000100:00100000:0.0:1787906795.171048:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787906795.171059:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000310656:12345-0@lo:13: 00002000:00000024:0.0:1787906795.171111:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906795.171172:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000310656:12345-0@lo:13: Request processed in 115us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906795.171199:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787906795.171338:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787906795.171490:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510328700 x1874756000310656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906795.171516:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000310656:0@lo:13: 00000100:00100000:3.0:1787906795.544735:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906795.544780:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906795.544836:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906795.544871:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971976832 00000100:00100000:3.0:1787906795.544883:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971976832 00000100:00100000:3.0:1787906795.544964:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:3.0:1787906795.544987:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755971976832:12345-192.168.204.20@tcp:400: 00000100:00100000:3.0:1787906795.545221:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755971976832:12345-192.168.204.20@tcp:400: Request processed in 236us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906795.545229:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00080000:3.0:1787906795.545269:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906795.545479:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971976704 00000100:00100000:1.0:1787906795.545484:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971976704 00000100:00100000:1.0:1787906795.545523:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 130 00000100:00100000:1.0:1787906795.545530:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:2344:x1874755971976704:12345-192.168.204.20@tcp:400: 00000100:00100000:1.0:1787906795.545562:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:2344:x1874755971976704:12345-192.168.204.20@tcp:400: Request processed in 33us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906795.545569:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 130 00000100:00100000:1.0:1787906795.545600:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971977088 00000100:00100000:1.0:1787906795.545604:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971977088 00000100:00100000:1.0:1787906795.545633:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1787906795.545640:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755971977088:12345-192.168.204.20@tcp:400: 00000100:00100000:1.0:1787906795.545667:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755971977088:12345-192.168.204.20@tcp:400: Request processed in 28us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906795.545673:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00080000:1.0:1787906795.545857:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787906795.547395:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906795.547468:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971976960 00000100:00100000:1.0:1787906795.547485:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971976960 00000100:00100000:1.0:1787906795.547544:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:1.0:1787906795.547553:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2344:x1874755971976960:12345-192.168.204.20@tcp:400: 00000100:00100000:1.0:1787906795.547613:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2344:x1874755971976960:12345-192.168.204.20@tcp:400: Request processed in 61us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906795.547620:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00080000:3.0:1787906795.547992:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787906796.194041:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787906796.441598:0:8292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787906797.216179:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906797.216244:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000310784:0@lo:400: 00000100:00100000:1.0:1787906797.216270:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000310912:0@lo:400: 00000100:00100000:1.0:1787906797.225096:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906797.225214:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000311424:0@lo:400: 00000100:00100000:1.0:1787906797.225276:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906797.225318:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787906797.225326:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000311296:0@lo:400: 00000100:00100000:1.0:1787906797.225360:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906797.225407:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000311040:0@lo:400: 00000100:00100000:1.0:1787906797.225432:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906797.225452:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906797.226121:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000311168:0@lo:400: 00000100:00100000:1.0:1787906797.226186:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906797.226249:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000311424 00000100:00100000:1.0:1787906797.226260:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000311424 00000100:00100000:1.0:1787906797.226334:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000311168 00000100:00100000:1.0:1787906797.226348:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000311168 00000100:00100000:1.0:1787906797.226371:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787906797.226381:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000311424:12345-0@lo:400: 00000100:00100000:1.0:1787906797.226453:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000311424:12345-0@lo:400: Request processed in 72us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906797.226537:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787906797.226649:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787906797.226656:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000311168:12345-0@lo:400: 00000100:00100000:1.0:1787906797.226694:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000311168:12345-0@lo:400: Request processed in 39us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906797.226700:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787906797.226721:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000310912 00000100:00100000:1.0:1787906797.226725:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000310912 00000100:00100000:1.0:1787906797.226745:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000311296 00000100:00100000:1.0:1787906797.226747:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000311296 00000100:00100000:1.0:1787906797.226759:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000311040 00000100:00100000:1.0:1787906797.226762:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000311040 00000100:00100000:1.0:1787906797.226776:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787906797.226782:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000310912:12345-0@lo:400: 00000100:00100000:1.0:1787906797.226838:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000310912:12345-0@lo:400: Request processed in 56us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906797.226845:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787906797.226857:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787906797.226862:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000311296:12345-0@lo:400: 00000100:00100000:1.0:1787906797.226890:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000311296:12345-0@lo:400: Request processed in 28us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906797.226896:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787906797.226905:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787906797.226910:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000311040:12345-0@lo:400: 00000100:00100000:1.0:1787906797.226937:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000311040:12345-0@lo:400: Request processed in 27us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906797.226943:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787906797.226973:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787906797.226988:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787906797.226991:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787906797.227363:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510213800 x1874756000311168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906797.227382:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000311168:0@lo:400: 00000100:00100000:1.0:1787906797.227399:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000311040:0@lo:400: 00000100:00100000:1.0:1787906797.227442:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000311296:0@lo:400: 00000100:00100000:1.0:1787906797.227456:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000310912:0@lo:400: 00010000:00080000:1.0:1787906797.227479:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510211500 x1874756000311424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906797.227489:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000311424:0@lo:400: 00000100:00100000:3.0:1787906797.228159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906797.233630:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000310784 00000100:00100000:1.0:1787906797.233651:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000310784 00000100:00100000:1.0:1787906797.233736:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787906797.233750:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000310784:12345-0@lo:400: 00000100:00100000:1.0:1787906797.233912:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000310784:12345-0@lo:400: Request processed in 164us (5757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906797.233920:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787906797.234630:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000310784:0@lo:400: 00000100:00100000:2.0:1787906797.729137:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787906797.729185:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000311552:0@lo:13: 00000100:00100000:2.0:1787906797.729352:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906797.729468:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000311552 00000100:00100000:2.0:1787906797.729480:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000311552 00000100:00100000:2.0:1787906797.729554:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787906797.729567:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000311552:12345-0@lo:13: 00002000:00000024:2.0:1787906797.729628:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906797.729690:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000311552:12345-0@lo:13: Request processed in 124us (338us total) trans 0 rc 0/0 00010000:00080000:3.0:1787906797.730246:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe0380 x1874756000311552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906797.730274:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000311552:0@lo:13: 00000100:00100000:2.0:1787906797.730380:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787906798.253359:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906799.266751:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906800.288116:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906800.289655:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000311680:0@lo:13: 00000100:00100000:3.0:1787906800.289768:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906800.289963:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000311680 00000100:00100000:1.0:1787906800.289976:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000311680 00000100:00100000:1.0:1787906800.290062:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787906800.290075:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000311680:12345-0@lo:13: 00002000:00000024:1.0:1787906800.290124:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906800.290191:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000311680:12345-0@lo:13: Request processed in 117us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906800.290210:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787906800.290266:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510328e00 x1874756000311680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906800.290306:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000311680:0@lo:13: 00000100:00080000:3.0:1787906800.291361:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906800.659207:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906800.659339:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971977344 00000100:00100000:2.0:1787906800.659354:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971977344 00000100:00100000:2.0:1787906800.659464:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:2.0:1787906800.659478:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755971977344:12345-192.168.204.20@tcp:400: 00000100:00100000:2.0:1787906800.659585:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755971977344:12345-192.168.204.20@tcp:400: Request processed in 110us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906800.659594:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00080000:0.0:1787906800.659720:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906800.665619:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906800.665693:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906800.666692:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971977216 00000100:00100000:0.0:1787906800.666710:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971977216 00000100:00100000:0.0:1787906800.666833:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 132 00000100:00100000:0.0:1787906800.666847:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:2346:x1874755971977216:12345-192.168.204.20@tcp:400: 00000100:00100000:0.0:1787906800.667071:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:2346:x1874755971977216:12345-192.168.204.20@tcp:400: Request processed in 226us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906800.667081:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 132 00000100:00100000:0.0:1787906800.667480:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971977472 00000100:00100000:0.0:1787906800.668142:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971977472 00000100:00100000:0.0:1787906800.668233:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:0.0:1787906800.668245:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755971977472:12345-192.168.204.20@tcp:400: 00000100:00100000:0.0:1787906800.668333:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755971977472:12345-192.168.204.20@tcp:400: Request processed in 90us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906800.668342:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00080000:0.0:1787906800.668369:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787906800.718645:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906800.719209:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971977600 00000100:00100000:3.0:1787906800.719225:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971977600 00000100:00100000:3.0:1787906800.719328:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:3.0:1787906800.719342:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2345:x1874755971977600:12345-192.168.204.20@tcp:400: 00000100:00080000:2.0:1787906800.719499:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787906800.719628:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2345:x1874755971977600:12345-192.168.204.20@tcp:400: Request processed in 288us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906800.719638:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00010000:00010000:3.0:1787906801.312076:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787906801.834663:0:8442:0:(class_obd.c:354:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe16f242a0 20000000:00000080:2.0:1787906801.834696:0:8442:0:(mgs_handler.c:1205:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8aa53b04d800 uarg=0000000000000000 20000000:01000000:2.0:1787906801.834758:0:8442:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787906801.834761:0:8442:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787906801.834766:0:8442:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787906801.834773:0:8442:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787906801.834781:0:8442:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787906801.834802:0:8442:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787906801.834851:0:8442:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787906801.835671:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787906801.835678:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787906801.837807:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787906801.843080:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787906801.843351:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787906801.843405:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1787906801.843439:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787906801.843443:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787906801.847799:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787906801.848625:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787906801.848699:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787906801.848756:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787906801.848774:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787906801.848778:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787906801.859477:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787906801.865621:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787906801.865728:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787906801.865766:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787906801.865785:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787906801.865790:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787906801.872080:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787906801.873036:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787906801.873102:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787906801.873142:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1787906801.873333:0:8442:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787906801.873366:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.873395:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa511995a00/0x72bb6cf063cad154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad14d expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.873406:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad177 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.873415:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa511995200/0x72bb6cf063cad1a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad1a1 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.873423:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa511994a00/0x72bb6cf063cad1b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad1af expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.873432:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa541c96400/0x72bb6cf063cad1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad1bd expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.873442:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad1d9 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.873451:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad203 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.873465:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa508211200/0x72bb6cf063cad218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f1 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.873474:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa511994e00/0x72bb6cf063cad21f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f8 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.873485:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.873568:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa511994e00/0x72bb6cf063cad21f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f8 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.873591:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa511994e00/0x72bb6cf063cad21f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f8 expref: 9 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906801.873613:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510328700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000311808:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906801.873867:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa508211200/0x72bb6cf063cad218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f1 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.873878:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa508211200/0x72bb6cf063cad218 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f1 expref: 9 pid: 5824 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906801.873889:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000311936:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906801.873926:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad20a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad203 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.873934:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad20a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad203 expref: 18 pid: 5823 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906801.873945:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000312064:0@lo:104: 00000100:00100000:0.0:1787906801.873999:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787906801.874047:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad1e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad1d9 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.874057:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad1e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad1d9 expref: 18 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906801.874078:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000312192:0@lo:104: 00000100:00100000:0.0:1787906801.874107:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787906801.874141:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa541c96400/0x72bb6cf063cad1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad1bd expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.874150:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa541c96400/0x72bb6cf063cad1c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad1bd expref: 18 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906801.874159:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000312320:0@lo:104: 00000100:00100000:3.0:1787906801.875833:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787906801.875874:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000312064 00000100:00100000:3.0:1787906801.875889:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000312064 00000100:00100000:3.0:1787906801.875973:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000312192 00000100:00100000:3.0:1787906801.875978:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000312192 00000100:00100000:3.0:1787906801.875999:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787906801.876013:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:8442:x1874756000312064:12345-0@lo:104: 00010000:00010000:3.0:1787906801.876039:0:6688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad20a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.876164:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787906801.876181:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:8442:x1874756000312064:12345-0@lo:104: Request processed in 161us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906801.876189:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787906801.876210:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787906801.876217:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534959050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:8442:x1874756000312192:12345-0@lo:104: 00010000:00010000:3.0:1787906801.876226:0:6688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad1e0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.876297:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787906801.876303:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534959050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:8442:x1874756000312192:12345-0@lo:104: Request processed in 87us (2195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906801.876309:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787906801.876373:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787906801.876381:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad20a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.876390:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211c00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906801.876395:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad20a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.876406:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad20a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906801.876414:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad20a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906801.876421:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787906801.876479:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad20a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.876487:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906801.876515:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad20a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.876523:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cad203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad20a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.876554:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787906801.876558:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad1e0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.876565:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030000 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906801.876568:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad1e0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.876576:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad1e0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906801.876583:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad1e0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906801.876589:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787906801.876604:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad1e0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.876610:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906801.876616:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad1e0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.876623:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa500030000/0x72bb6cf063cad1d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad1e0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.876633:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906801.876635:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906801.876637:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906801.876644:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906801.876672:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000312448:0@lo:103: 00000100:00100000:3.0:1787906801.876718:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906801.876758:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787906801.876764:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000312576:0@lo:103: 00000100:00100000:3.0:1787906801.876786:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906801.876841:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000312448 00000100:00100000:3.0:1787906801.876847:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000312448 00010000:00010000:3.0:1787906801.876872:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad20a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad203 expref: 19 pid: 5823 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906801.876897:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000312576 00000100:00100000:3.0:1787906801.876900:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000312576 00010000:00010000:3.0:1787906801.876911:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad1e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad1d9 expref: 20 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906801.876925:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787906801.876932:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+20:3303:x1874756000312448:12345-0@lo:103: 00010000:00010000:3.0:1787906801.876945:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906801.876952:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad20a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad203 expref: 20 pid: 5823 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.876963:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad20a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad203 expref: 20 pid: 5823 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.876992:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906801.877023:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+20:3303:x1874756000312448:12345-0@lo:103: Request processed in 91us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906801.877030:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787906801.877043:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787906801.877050:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000312576:12345-0@lo:103: 00010000:00010000:3.0:1787906801.877067:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906801.877072:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad1e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad1d9 expref: 19 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.877083:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad1e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad1d9 expref: 19 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.877093:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906801.877116:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000312576:12345-0@lo:103: Request processed in 66us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906801.877121:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787906801.877170:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000312576:0@lo:103: 00000100:00100000:3.0:1787906801.877180:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000312448:0@lo:103: 00000100:00100000:0.0:1787906801.877424:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787906801.877477:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa511994a00/0x72bb6cf063cad1b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad1af expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.877492:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa511994a00/0x72bb6cf063cad1b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad1af expref: 18 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906801.877506:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000312704:0@lo:104: 00000100:00100000:0.0:1787906801.877533:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787906801.877558:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa511995200/0x72bb6cf063cad1a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad1a1 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.877568:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa511995200/0x72bb6cf063cad1a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad1a1 expref: 18 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906801.877577:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000312832:0@lo:104: 00000100:00100000:0.0:1787906801.877598:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787906801.877617:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad177 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.877640:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad17e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad177 expref: 18 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906801.877650:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000312960:0@lo:104: 00000100:00100000:0.0:1787906801.877676:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787906801.877696:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa511995a00/0x72bb6cf063cad154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad14d expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.877705:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa511995a00/0x72bb6cf063cad154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad14d expref: 18 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906801.877714:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000313088:0@lo:104: 00000100:00100000:0.0:1787906801.877735:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906801.877747:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53afb0240 going to sleep for 11 seconds 00010000:00010000:0.0:1787906801.877766:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad20a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad203 expref: 18 pid: 5823 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906801.877782:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000312064:0@lo:104: 00010000:00010000:0.0:1787906801.877794:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad1e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad1d9 expref: 17 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906801.877802:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000312192:0@lo:104: 00000100:00100000:3.0:1787906801.881370:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000312320 00000100:00100000:3.0:1787906801.881393:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000312320 00000100:00100000:3.0:1787906801.881469:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000312704 00000100:00100000:3.0:1787906801.881473:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000312704 00000100:00100000:3.0:1787906801.881486:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000312832 00000100:00100000:3.0:1787906801.881490:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000312832 00000100:00100000:3.0:1787906801.881501:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000312960 00000100:00100000:3.0:1787906801.881504:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000312960 00000100:00100000:3.0:1787906801.881518:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000313088 00000100:00100000:3.0:1787906801.881522:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000313088 00000100:00100000:3.0:1787906801.881543:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787906801.881556:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+7:8442:x1874756000312320:12345-0@lo:104: 00010000:00010000:3.0:1787906801.881580:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad1c4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.881743:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787906801.881773:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+7:8442:x1874756000312320:12345-0@lo:104: Request processed in 219us (4349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906801.881782:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787906801.881805:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787906801.881833:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+6:8442:x1874756000312704:12345-0@lo:104: 00010000:00010000:3.0:1787906801.881843:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad1b6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.881885:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787906801.881891:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+6:8442:x1874756000312704:12345-0@lo:104: Request processed in 81us (4357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906801.881897:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787906801.881910:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787906801.881917:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+5:8442:x1874756000312832:12345-0@lo:104: 00010000:00010000:3.0:1787906801.881927:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad1a8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.881959:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787906801.881965:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+5:8442:x1874756000312832:12345-0@lo:104: Request processed in 49us (4367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906801.881970:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787906801.881982:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787906801.881988:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:8442:x1874756000312960:12345-0@lo:104: 00010000:00010000:3.0:1787906801.881997:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad17e expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.882027:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787906801.882038:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:8442:x1874756000312960:12345-0@lo:104: Request processed in 51us (4362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906801.882045:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787906801.882058:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787906801.882064:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:8442:x1874756000313088:12345-0@lo:104: 00010000:00010000:3.0:1787906801.882073:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad154 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.882108:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787906801.882114:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:8442:x1874756000313088:12345-0@lo:104: Request processed in 50us (4378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906801.882141:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787906801.882168:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:0.0:1787906801.883762:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000312320:0@lo:104: 00000100:00100000:0.0:1787906801.883780:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000312704:0@lo:104: 00000100:00100000:0.0:1787906801.883791:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000312832:0@lo:104: 00000100:00100000:0.0:1787906801.883801:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000312960:0@lo:104: 00000100:00100000:0.0:1787906801.883867:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000313088:0@lo:104: 00010000:00010000:3.0:1787906801.884058:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad1c4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.884070:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030a00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906801.884076:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad1c4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.884088:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad1c4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906801.884096:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad1c4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906801.884104:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787906801.884268:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad1c4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.884289:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787906801.884357:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000313216:0@lo:103: 00000100:00100000:1.0:1787906801.884447:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906801.885093:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000313216 00000100:00100000:0.0:1787906801.885106:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000313216 00010000:00010000:0.0:1787906801.885168:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa541c96400/0x72bb6cf063cad1c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad1bd expref: 17 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906801.885226:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787906801.885238:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:3301:x1874756000313216:12345-0@lo:103: 00010000:00010000:0.0:1787906801.885269:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906801.885277:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa541c96400/0x72bb6cf063cad1c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad1bd expref: 17 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.885291:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa541c96400/0x72bb6cf063cad1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad1bd expref: 17 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.885314:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa541c96400/0x72bb6cf063cad1c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad1bd expref: 17 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.885336:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787906801.885727:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad1c4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.885738:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa500030a00/0x72bb6cf063cad1bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad1c4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.885757:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787906801.885761:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad1b6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.885769:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030800 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906801.885773:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad1b6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.885782:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad1b6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906801.885790:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad1b6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906801.885795:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787906801.885848:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad1b6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.885856:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787906801.886766:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:3301:x1874756000313216:12345-0@lo:103: Request processed in 1519us (2308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906801.886781:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787906801.886914:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787906801.887531:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad1b6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.887544:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa500030800/0x72bb6cf063cad1af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad1b6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.887570:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787906801.887574:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad17e expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.887582:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211800 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906801.887586:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad17e expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.887596:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad17e expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906801.887605:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad17e expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906801.887612:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787906801.887669:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad17e expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.887677:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906801.887701:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad17e expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.887708:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa508211800/0x72bb6cf063cad177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad17e expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.887718:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787906801.887722:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad154 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.887740:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210e00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906801.887743:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad154 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.887751:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad154 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906801.887757:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad154 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906801.887762:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787906801.887777:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad154 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.887784:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906801.887789:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad154 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.887795:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa508210e00/0x72bb6cf063cad14d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad154 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.887805:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906801.887807:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906801.887809:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906801.887853:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000313344:0@lo:103: 00000100:00100000:3.0:1787906801.887943:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906801.888039:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000313344 00000100:00100000:3.0:1787906801.888050:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000313344 00010000:00010000:3.0:1787906801.888090:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa511994a00/0x72bb6cf063cad1b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad1af expref: 16 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906801.888315:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787906801.888326:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:3302:x1874756000313344:12345-0@lo:103: 00010000:00010000:3.0:1787906801.888345:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906801.888352:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa511994a00/0x72bb6cf063cad1b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad1af expref: 16 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.888363:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa511994a00/0x72bb6cf063cad1b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad1af expref: 16 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.888381:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511994a00/0x72bb6cf063cad1b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad1af expref: 16 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.888396:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906801.888436:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:3302:x1874756000313344:12345-0@lo:103: Request processed in 112us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906801.888450:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787906801.888503:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000313344:0@lo:103: 00000100:00100000:3.0:1787906801.888542:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000313472:0@lo:103: 00000100:00100000:3.0:1787906801.888569:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906801.888592:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787906801.888598:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000313600:0@lo:103: 00000100:00100000:3.0:1787906801.888621:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906801.888643:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000313472 00000100:00100000:3.0:1787906801.888647:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000313472 00010000:00010000:3.0:1787906801.888661:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad17e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad177 expref: 15 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906801.888692:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000313600 00000100:00100000:3.0:1787906801.888696:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000313600 00010000:00010000:3.0:1787906801.888710:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa511995a00/0x72bb6cf063cad154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad14d expref: 16 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906801.888724:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787906801.888730:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:3303:x1874756000313472:12345-0@lo:103: 00010000:00010000:3.0:1787906801.888739:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906801.888743:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad17e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad177 expref: 16 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.888752:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad177 expref: 16 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.888763:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad17e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad177 expref: 16 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.888774:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906801.888803:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:3303:x1874756000313472:12345-0@lo:103: Request processed in 72us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906801.888809:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787906801.888856:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787906801.888863:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:3303:x1874756000313600:12345-0@lo:103: 00010000:00010000:3.0:1787906801.888874:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906801.888880:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa511995a00/0x72bb6cf063cad154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad14d expref: 14 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.888887:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa511995a00/0x72bb6cf063cad154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad14d expref: 14 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.888905:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511995a00/0x72bb6cf063cad154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad14d expref: 14 pid: 5825 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.888914:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906801.888937:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:3303:x1874756000313600:12345-0@lo:103: Request processed in 75us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906801.888943:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787906801.888968:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000313600:0@lo:103: 00000100:00100000:3.0:1787906801.888975:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000313472:0@lo:103: 00000100:00100000:1.0:1787906801.890036:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000313216:0@lo:103: 00010000:00010000:2.0:1787906801.890621:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906801.890626:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906801.890629:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906801.890663:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad1a8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.890676:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031200 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906801.890681:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad1a8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.890691:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad1a8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906801.890700:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad1a8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906801.890706:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787906801.890801:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad1a8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.890808:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906801.890863:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad1a8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.890886:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa500031200/0x72bb6cf063cad1a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad1a8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.890904:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906801.890906:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906801.890908:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906801.890985:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787906801.891006:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000313728:0@lo:103: 00000100:00100000:0.0:1787906801.891089:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906801.891298:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000313728 00000100:00100000:3.0:1787906801.891308:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000313728 00010000:00010000:3.0:1787906801.891343:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa511995200/0x72bb6cf063cad1a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad1a1 expref: 13 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906801.891381:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787906801.891391:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510227050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:3302:x1874756000313728:12345-0@lo:103: 00010000:00010000:3.0:1787906801.891405:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906801.891413:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa511995200/0x72bb6cf063cad1a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad1a1 expref: 13 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.891425:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa511995200/0x72bb6cf063cad1a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad1a1 expref: 13 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.891442:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511995200/0x72bb6cf063cad1a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad1a1 expref: 13 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906801.891456:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906801.891677:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510227050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:3302:x1874756000313728:12345-0@lo:103: Request processed in 287us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906801.891686:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787906801.892976:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000313728:0@lo:103: 00000100:00100000:2.0:1787906801.894066:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906801.894120:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906801.894378:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971977856 00000100:00100000:1.0:1787906801.894392:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971977856 00010000:00010000:1.0:1787906801.894449:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa508211200/0x72bb6cf063cad218 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f1 expref: 10 pid: 5824 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906801.894495:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971977728 00000100:00100000:1.0:1787906801.894499:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971977728 00010000:00010000:1.0:1787906801.894513:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa511994e00/0x72bb6cf063cad21f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f8 expref: 11 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906801.894532:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:1.0:1787906801.894544:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9eec00eb-d19d-4892-ad44-299469e66291+11:2345:x1874755971977856:12345-192.168.204.20@tcp:103: 00010000:00010000:1.0:1787906801.894567:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906801.894574:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa508211200/0x72bb6cf063cad218 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f1 expref: 11 pid: 5824 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906801.894588:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa508211200/0x72bb6cf063cad218 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f1 expref: 11 pid: 5824 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906801.894653:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906801.894729:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9eec00eb-d19d-4892-ad44-299469e66291+11:2345:x1874755971977856:12345-192.168.204.20@tcp:103: Request processed in 187us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906801.894737:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:1.0:1787906801.894764:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:1.0:1787906801.894771:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9eec00eb-d19d-4892-ad44-299469e66291+10:2345:x1874755971977728:12345-192.168.204.20@tcp:103: 00010000:00010000:1.0:1787906801.894779:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906801.894784:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa511994e00/0x72bb6cf063cad21f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f8 expref: 10 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906801.894795:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa511994e00/0x72bb6cf063cad21f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f8 expref: 10 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906801.894848:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906801.894859:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906801.894881:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906801.894890:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906801.894899:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906801.894907:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906801.894922:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8ea00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:1.0:1787906801.894927:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906801.894937:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906801.894947:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906801.894963:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906801.894985:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9eec00eb-d19d-4892-ad44-299469e66291+10:2345:x1874755971977728:12345-192.168.204.20@tcp:103: Request processed in 215us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906801.894992:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00010000:00010000:0.0:1787906801.895790:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511994e00/0x72bb6cf063cad21f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f8 expref: 9 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906801.896030:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510328700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000311808:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906801.896048:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa508211200/0x72bb6cf063cad218 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef4f1 expref: 8 pid: 5824 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906801.896058:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1874756000311936:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906801.896261:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.896276:0:8442:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.896284:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906801.896290:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad257 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906802.336060:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906802.337119:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874756000314240:0@lo:400: 00000100:00100000:1.0:1787906802.337248:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906802.337338:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787906802.337345:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000313856:0@lo:400: 00000100:00100000:1.0:1787906802.337370:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906802.337388:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000314368:0@lo:400: 00000100:00100000:1.0:1787906802.338005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906802.338061:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000313984:0@lo:400: 00000100:00100000:1.0:1787906802.338108:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906802.338131:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787906802.338138:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000314112:0@lo:400: 00000100:00100000:1.0:1787906802.338190:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906802.338252:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000314240 00000100:00100000:1.0:1787906802.338264:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000314240 00000100:00100000:1.0:1787906802.338339:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000313856 00000100:00100000:1.0:1787906802.338343:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000313856 00000100:00100000:1.0:1787906802.338357:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000313984 00000100:00100000:1.0:1787906802.338360:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000313984 00000100:00100000:1.0:1787906802.338380:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787906802.338390:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874756000314240:12345-0@lo:400: 00000100:00100000:1.0:1787906802.339806:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874756000314240:12345-0@lo:400: Request processed in 1411us (2564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906802.339844:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787906802.339906:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787906802.339920:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000313856:12345-0@lo:400: 00000100:00100000:1.0:1787906802.339955:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000313856:12345-0@lo:400: Request processed in 40us (2584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906802.339961:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787906802.339973:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787906802.339980:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000313984:12345-0@lo:400: 00000100:00100000:1.0:1787906802.340018:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000313984:12345-0@lo:400: Request processed in 39us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906802.340025:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787906802.340064:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000314368 00000100:00100000:1.0:1787906802.340073:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000314368 00000100:00100000:1.0:1787906802.340125:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000314112 00000100:00100000:1.0:1787906802.340129:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000314112 00000100:00100000:1.0:1787906802.340151:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787906802.340159:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000314368:12345-0@lo:400: 00000100:00100000:3.0:1787906802.340177:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787906802.340192:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787906802.340207:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000314368:12345-0@lo:400: Request processed in 49us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906802.340234:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787906802.340253:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787906802.340260:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787906802.340261:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787906802.340265:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906802.340271:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000314112:12345-0@lo:400: 00000100:00100000:1.0:1787906802.340312:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000314112:12345-0@lo:400: Request processed in 43us (2121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906802.340320:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787906802.340321:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000313856:0@lo:400: 00010000:00080000:3.0:1787906802.340348:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510213100 x1874756000314368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787906802.340359:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510213b80 x1874756000314112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906802.340363:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000314368:0@lo:400: 00000100:00100000:1.0:1787906802.340379:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000314112:0@lo:400: 00000100:00100000:3.0:1787906802.340395:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874756000314240:0@lo:400: 00000100:00100000:1.0:1787906802.340399:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000313984:0@lo:400: 00000100:00100000:1.0:1787906802.850546:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000314496:0@lo:13: 00000100:00100000:1.0:1787906802.850676:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906802.851473:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000314496 00000100:00100000:3.0:1787906802.851487:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000314496 00000100:00100000:3.0:1787906802.851576:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787906802.851589:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000314496:12345-0@lo:13: 00002000:00000024:3.0:1787906802.851648:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906802.851730:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000314496:12345-0@lo:13: Request processed in 142us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906802.851738:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787906802.851969:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe0a80 x1874756000314496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906802.852002:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000314496:0@lo:13: 10000000:01000000:2.0:1787906803.104063:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787906803.104074:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8aa401350800 from 39 10000000:01000000:2.0:1787906803.104082:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787906803.104172:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906803.104188:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906803.104205:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906803.104254:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000314624:0@lo:101: 00000100:00100000:2.0:1787906803.104395:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906803.104481:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50306d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787906803.106931:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000314624 00000100:00100000:1.0:1787906803.106958:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000314624 00000100:00100000:1.0:1787906803.107051:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787906803.107063:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+12:5827:x1874756000314624:12345-0@lo:101: 00010000:00010000:1.0:1787906803.107089:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906803.107118:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa508211600/0x72bb6cf063cad265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad25e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906803.107168:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508211600/0x72bb6cf063cad265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad25e expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906803.107204:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa508211600/0x72bb6cf063cad265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad25e expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906803.107216:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211600, rc 0) 00000100:00100000:1.0:1787906803.107343:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:5827:x1874756000314624:12345-0@lo:101: Request processed in 281us (2948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906803.107350:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787906803.108307:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000314624:0@lo:101: 00010000:00010000:2.0:1787906803.108340:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad265 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906803.108354:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad265 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906803.108482:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000314752:0@lo:501: 00000100:00100000:2.0:1787906803.108536:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906803.108593:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50306d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787906803.109425:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000314752 00000100:00100000:1.0:1787906803.109440:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000314752 00000100:00100000:1.0:1787906803.109508:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787906803.109518:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:5827:x1874756000314752:12345-0@lo:501: 00000100:00100000:1.0:1787906803.109962:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:5827:x1874756000314752:12345-0@lo:501: Request processed in 443us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906803.109972:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787906803.110395:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000314752:0@lo:501: 00000100:00100000:3.0:1787906803.110472:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000314880:0@lo:503: 00000100:00100000:3.0:1787906803.110538:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906803.110585:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4000 going to sleep for 11 seconds 00000100:00100000:0.0:1787906803.110845:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000314880 00000100:00100000:0.0:1787906803.110853:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000314880 00000100:00100000:0.0:1787906803.110912:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787906803.110921:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:5827:x1874756000314880:12345-0@lo:503: 00000100:00100000:0.0:1787906803.111146:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:5827:x1874756000314880:12345-0@lo:503: Request processed in 226us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906803.111153:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787906803.111479:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000314880:0@lo:503: 00000100:00100000:3.0:1787906803.113453:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8460:1874756000315008:0@lo:502: 00000100:00100000:3.0:1787906803.113568:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906803.113635:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787906803.113994:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000315008 00000100:00100000:0.0:1787906803.114004:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000315008 00000100:00100000:0.0:1787906803.114061:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787906803.114071:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:8460:x1874756000315008:12345-0@lo:502: 00000100:00100000:0.0:1787906803.114566:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:8460:x1874756000315008:12345-0@lo:502: Request processed in 494us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906803.114576:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787906803.114733:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8460:1874756000315008:0@lo:502: 00000100:00100000:3.0:1787906803.114800:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8460:1874756000315136:0@lo:502: 00000100:00100000:3.0:1787906803.114876:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906803.114907:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906803.115117:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000315136 00000100:00100000:1.0:1787906803.115124:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000315136 00000100:00100000:1.0:1787906803.115170:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787906803.115179:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:8460:x1874756000315136:12345-0@lo:502: 00000100:00100000:1.0:1787906803.115432:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:8460:x1874756000315136:12345-0@lo:502: Request processed in 250us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906803.115440:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787906803.116015:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8460:1874756000315136:0@lo:502: 00000040:00080000:0.0:1787906803.116064:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787906803.116328:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787906803.116361:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787906803.117794:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad265 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.118035:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad265 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906803.118051:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787906803.118055:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787906803.118060:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787906803.118132:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.118142:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.118154:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906803.118193:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000315264:0@lo:101: 00000100:00100000:3.0:1787906803.118308:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906803.118376:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4840 going to sleep for 11 seconds 00000100:00100000:0.0:1787906803.118571:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000315264 00000100:00100000:0.0:1787906803.118581:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000315264 00000100:00100000:0.0:1787906803.118651:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787906803.118663:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+13:5827:x1874756000315264:12345-0@lo:101: 00010000:00010000:0.0:1787906803.118680:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906803.118697:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad26c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906803.118726:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad26c expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906803.118738:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad26c expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906803.118748:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8ea00, rc 0) 00000100:00100000:0.0:1787906803.118804:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000315264:12345-0@lo:101: Request processed in 142us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906803.118840:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787906803.118997:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000315264:0@lo:101: 00010000:00010000:3.0:1787906803.119032:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.119042:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906803.119113:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000315392:0@lo:501: 00000100:00100000:3.0:1787906803.119141:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906803.119171:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4840 going to sleep for 11 seconds 00000100:00100000:2.0:1787906803.119267:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000315392 00000100:00100000:2.0:1787906803.119273:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000315392 00000100:00100000:2.0:1787906803.119310:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787906803.119317:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000315392:12345-0@lo:501: 00000100:00100000:2.0:1787906803.120328:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000315392:12345-0@lo:501: Request processed in 1005us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906803.120340:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787906803.122095:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000315392:0@lo:501: 00000100:00100000:3.0:1787906803.122183:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000315520:0@lo:503: 00000100:00100000:3.0:1787906803.122298:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906803.122473:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4840 going to sleep for 11 seconds 00000100:00100000:0.0:1787906803.122599:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000315520 00000100:00100000:0.0:1787906803.122610:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000315520 00000100:00100000:0.0:1787906803.122737:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787906803.122750:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000315520:12345-0@lo:503: 00000100:00100000:0.0:1787906803.123259:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000315520:12345-0@lo:503: Request processed in 509us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906803.123279:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787906803.123564:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000315520:0@lo:503: 00000100:00100000:1.0:1787906803.127123:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8461:1874756000315648:0@lo:502: 00000100:00100000:1.0:1787906803.127284:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906803.127343:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787906803.127776:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000315648 00000100:00100000:3.0:1787906803.127786:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000315648 00000100:00100000:3.0:1787906803.127873:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787906803.127886:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:8461:x1874756000315648:12345-0@lo:502: 00000100:00100000:3.0:1787906803.128193:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:8461:x1874756000315648:12345-0@lo:502: Request processed in 308us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906803.128201:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787906803.128361:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8461:1874756000315648:0@lo:502: 00000020:01000000:0.0:1787906803.128418:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787906803.128431:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787906803.128434:0:8461:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787906803.128440:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787906803.128488:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8461:1874756000315776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787906803.128536:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906803.128561:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53afb0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787906803.129864:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000315776 00000100:00100000:1.0:1787906803.129888:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000315776 00000100:00100000:1.0:1787906803.130010:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787906803.130023:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:8461:x1874756000315776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787906803.130728:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:8461:x1874756000315776:12345-0@lo:502:llog_process_th.0 Request processed in 704us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906803.130738:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787906803.130945:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8461:1874756000315776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787906803.130992:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787906803.131003:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787906803.131006:0:8461:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787906803.131010:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787906803.131241:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787906803.131268:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787906803.131283:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.131294:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906803.131316:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787906803.131320:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8aa510341800 from 39 10000000:01000000:3.0:1787906803.131323:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787906803.131363:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.131384:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.131395:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906803.131420:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000315904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787906803.131605:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906803.131656:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787906803.131937:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000315904 00000100:00100000:0.0:1787906803.131947:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000315904 00000100:00100000:0.0:1787906803.131989:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787906803.131998:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:5827:x1874756000315904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787906803.132013:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906803.132029:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa53ac8fa00/0x72bb6cf063cad281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad27a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906803.132059:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa53ac8fa00/0x72bb6cf063cad281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad27a expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906803.132071:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa53ac8fa00/0x72bb6cf063cad281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad27a expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906803.132095:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8fa00, rc 0) 00000100:00100000:0.0:1787906803.132144:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000315904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906803.132151:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787906803.132527:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000315904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787906803.132544:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.132556:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906803.132631:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000316032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787906803.132667:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906803.132702:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787906803.132809:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000316032 00000100:00100000:1.0:1787906803.132838:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000316032 00000100:00100000:1.0:1787906803.132872:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787906803.132880:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000316032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906803.133211:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000316032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906803.133218:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787906803.133575:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000316032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787906803.133630:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000316160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787906803.133694:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906803.133733:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787906803.134276:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000316160 00000100:00100000:1.0:1787906803.134285:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000316160 00000100:00100000:1.0:1787906803.134327:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787906803.134336:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000316160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787906803.135390:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000316160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1047us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906803.135403:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787906803.136633:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000316160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787906803.138247:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8462:1874756000316288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787906803.138357:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906803.138421:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787906803.138586:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000316288 00000100:00100000:0.0:1787906803.138597:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000316288 00000100:00100000:0.0:1787906803.138660:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787906803.138672:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:8462:x1874756000316288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787906803.139024:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:8462:x1874756000316288:12345-0@lo:502:llog_process_th.0 Request processed in 353us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906803.139032:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787906803.139213:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8462:1874756000316288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787906803.139362:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8462:1874756000316416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787906803.139411:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906803.139445:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4180 going to sleep for 11 seconds 00000100:00100000:1.0:1787906803.139500:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000316416 00000100:00100000:1.0:1787906803.139506:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000316416 00000100:00100000:1.0:1787906803.139542:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787906803.139550:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:8462:x1874756000316416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787906803.139739:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:8462:x1874756000316416:12345-0@lo:502:llog_process_th.0 Request processed in 188us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906803.139746:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787906803.139896:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8462:1874756000316416:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787906803.139920:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787906803.140176:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787906803.140200:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787906803.140213:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906803.140237:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787906803.140249:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787906803.140253:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787906803.140256:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787906803.140299:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906803.140308:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906803.140318:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906803.140336:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000316544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787906803.140375:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906803.140411:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787906803.140464:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000316544 00000100:00100000:3.0:1787906803.140469:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000316544 00000100:00100000:3.0:1787906803.140519:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787906803.140527:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:5827:x1874756000316544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787906803.140540:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906803.140559:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511994a00/0x72bb6cf063cad28f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad288 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.140592:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511994a00/0x72bb6cf063cad28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad288 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.140605:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511994a00/0x72bb6cf063cad28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad288 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.140617:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511994a00, rc 0) 00000100:00100000:3.0:1787906803.140663:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000316544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906803.140669:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787906803.141070:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000316544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787906803.141091:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad28f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906803.141102:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad28f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906803.141181:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000316672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906803.141218:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906803.141255:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787906803.141319:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000316672 00000100:00100000:3.0:1787906803.141324:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000316672 00000100:00100000:3.0:1787906803.141356:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787906803.141372:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000316672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787906803.141714:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000316672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906803.141722:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787906803.141796:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000316672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906803.141877:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000316800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787906803.141921:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906803.141940:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787906803.143418:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000316800 00000100:00100000:3.0:1787906803.143436:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000316800 00000100:00100000:3.0:1787906803.143530:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787906803.143543:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000316800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787906803.143884:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000316800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 343us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906803.143893:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787906803.144086:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000316800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906803.144739:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8463:1874756000316928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906803.144800:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906803.144863:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50306da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906803.144922:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000316928 00000100:00100000:1.0:1787906803.144929:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000316928 00000100:00100000:1.0:1787906803.144974:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787906803.144982:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:8463:x1874756000316928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787906803.145190:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:8463:x1874756000316928:12345-0@lo:502:llog_process_th.0 Request processed in 208us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906803.145199:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787906803.145760:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8463:1874756000316928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787906803.145804:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787906803.145857:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906803.145861:0:8463:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787906803.145868:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787906803.145910:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8463:1874756000317056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906803.145964:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906803.145989:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50306da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906803.146194:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000317056 00000100:00100000:1.0:1787906803.146201:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000317056 00000100:00100000:1.0:1787906803.146255:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787906803.146263:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:8463:x1874756000317056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787906803.146501:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:8463:x1874756000317056:12345-0@lo:502:llog_process_th.0 Request processed in 238us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906803.146509:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787906803.146952:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8463:1874756000317056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787906803.146988:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787906803.146995:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906803.146996:0:8463:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787906803.147002:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787906803.147323:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787906803.147404:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787906803.147428:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad28f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906803.147470:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad28f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787906803.147501:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787906803.147505:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8aa51a4db800 from 39 10000000:01000000:1.0:1787906803.147511:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787906803.147564:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906803.147573:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906803.147584:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906803.147611:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000317184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787906803.147711:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906803.147927:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906803.153547:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000317184 00000100:00100000:2.0:1787906803.153569:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000317184 00000100:00100000:2.0:1787906803.153657:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787906803.153671:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000317184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787906803.153696:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906803.153722:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa541c97c00/0x72bb6cf063cad29d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad296 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906803.154107:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c97c00/0x72bb6cf063cad29d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad296 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906803.154123:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa541c97c00/0x72bb6cf063cad29d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad296 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906803.154134:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97c00, rc 0) 00000100:00100000:2.0:1787906803.154255:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000317184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 586us (6546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906803.154263:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787906803.154417:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000317184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787906803.154449:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906803.154460:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906803.154562:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000317312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906803.154607:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906803.154664:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787906803.154718:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000317312 00000100:00100000:0.0:1787906803.154724:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000317312 00000100:00100000:0.0:1787906803.154762:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787906803.154770:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000317312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787906803.155147:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000317312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906803.155156:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787906803.158383:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000317312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906803.158510:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000317440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906803.158636:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906803.158694:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50306d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787906803.158966:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000317440 00000100:00100000:1.0:1787906803.158978:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000317440 00000100:00100000:1.0:1787906803.159059:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787906803.159072:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000317440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787906803.159430:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000317440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 358us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906803.159439:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787906803.159795:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000317440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787906803.164045:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8464:1874756000317568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787906803.164181:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906803.164257:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2180 going to sleep for 11 seconds 00000100:00100000:3.0:1787906803.164279:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000317568 00000100:00100000:3.0:1787906803.164291:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000317568 00000100:00100000:3.0:1787906803.164358:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787906803.164370:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:8464:x1874756000317568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787906803.165173:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:8464:x1874756000317568:12345-0@lo:502:llog_process_th.0 Request processed in 800us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906803.165184:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787906803.165249:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8464:1874756000317568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787906803.165327:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8464:1874756000317696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787906803.165386:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906803.165423:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2180 going to sleep for 11 seconds 00000100:00100000:0.0:1787906803.165496:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000317696 00000100:00100000:0.0:1787906803.165502:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000317696 00000100:00100000:0.0:1787906803.165544:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787906803.165555:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:8464:x1874756000317696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787906803.165758:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:8464:x1874756000317696:12345-0@lo:502:llog_process_th.0 Request processed in 204us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906803.165772:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787906803.166178:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8464:1874756000317696:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787906803.166233:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787906803.167068:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787906803.167107:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787906803.167121:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906803.167135:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906803.167148:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787906803.167152:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787906803.167155:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787906803.167208:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906803.167218:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906803.167239:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906803.167264:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000317824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787906803.167338:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906803.167397:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53afb0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787906803.168697:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000317824 00000100:00100000:3.0:1787906803.168715:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000317824 00000100:00100000:3.0:1787906803.168827:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787906803.168842:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000317824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787906803.168863:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906803.168886:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511994600/0x72bb6cf063cad2ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad2a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.168921:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511994600/0x72bb6cf063cad2ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad2a4 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.168932:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511994600/0x72bb6cf063cad2ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad2a4 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.168942:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511994600, rc 0) 00000100:00100000:3.0:1787906803.169042:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000317824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906803.169049:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787906803.169141:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000317824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787906803.169165:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906803.169178:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906803.169283:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000317952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906803.169327:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906803.169381:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787906803.170828:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000317952 00000100:00100000:3.0:1787906803.170843:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000317952 00000100:00100000:3.0:1787906803.170912:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787906803.170925:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000317952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787906803.172937:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000317952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2004us (3598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906803.172954:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787906803.173278:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000317952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787906803.173394:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000318080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787906803.173620:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906803.173692:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53afb0000 going to sleep for 11 seconds 00000100:00100000:2.0:1787906803.173832:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000318080 00000100:00100000:2.0:1787906803.173841:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000318080 00000100:00100000:2.0:1787906803.173894:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787906803.173905:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000318080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906803.174293:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000318080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 388us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906803.174301:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787906803.174585:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000318080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787906803.176471:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8465:1874756000318208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787906803.176673:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906803.176782:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787906803.177053:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000318208 00000100:00100000:0.0:1787906803.177063:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000318208 00000100:00100000:0.0:1787906803.177141:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787906803.177155:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:8465:x1874756000318208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787906803.177587:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:8465:x1874756000318208:12345-0@lo:502:llog_process_th.0 Request processed in 433us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906803.177597:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787906803.177788:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8465:1874756000318208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787906803.177866:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787906803.177881:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787906803.177884:0:8465:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787906803.177894:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787906803.177932:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8465:1874756000318336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787906803.177979:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906803.178014:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787906803.178455:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000318336 00000100:00100000:3.0:1787906803.178464:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000318336 00000100:00100000:3.0:1787906803.178526:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787906803.178535:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:8465:x1874756000318336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787906803.178800:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:8465:x1874756000318336:12345-0@lo:502:llog_process_th.0 Request processed in 266us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906803.178831:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787906803.178855:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8465:1874756000318336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787906803.178889:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787906803.178896:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787906803.178898:0:8465:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787906803.178902:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787906803.179189:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787906803.179214:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787906803.179239:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906803.179253:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906803.179267:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787906803.179271:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8aa510bd0000 from 1 10000000:01000000:0.0:1787906803.179274:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787906803.179320:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8f000/0x72bb6cf063cad2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906803.179329:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8f000/0x72bb6cf063cad2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906803.179340:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8f000/0x72bb6cf063cad2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906803.179378:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000318464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787906803.179451:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906803.179576:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53afb00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787906803.180237:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000318464 00000100:00100000:2.0:1787906803.180248:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000318464 00000100:00100000:2.0:1787906803.180319:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787906803.180456:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000318464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787906803.180472:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906803.180502:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511994c00/0x72bb6cf063cad2b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad2b2 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.180534:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511994c00/0x72bb6cf063cad2b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad2b2 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.180547:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511994c00/0x72bb6cf063cad2b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad2b2 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906803.180557:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511994c00, rc 0) 00000100:00100000:3.0:1787906803.180665:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000318464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 338us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906803.180673:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787906803.182152:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000318464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787906803.182188:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8f000/0x72bb6cf063cad2b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906803.182202:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8f000/0x72bb6cf063cad2b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad2b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906803.182311:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000318592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906803.182399:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906803.182448:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787906803.182648:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000318592 00000100:00100000:0.0:1787906803.182657:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000318592 00000100:00100000:0.0:1787906803.182712:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787906803.182722:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000318592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787906803.183086:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000318592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 363us (685us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787906803.183095:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787906803.183416:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000318592:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787906803.183490:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787906803.183501:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8f000/0x72bb6cf063cad2b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906803.183513:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8f000/0x72bb6cf063cad2b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906803.361503:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906804.384537:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906805.409078:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906805.409375:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787906805.409408:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000318720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787906805.409506:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906805.409802:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000318720 00000100:00100000:1.0:1787906805.409840:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000318720 00000100:00100000:1.0:1787906805.409920:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787906805.409932:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000318720:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787906805.409952:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787906805.409991:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906805.415223:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000318720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5276us (5699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906805.415244:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787906805.416290:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe7100 x1874756000318720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906805.416331:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000318720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906805.776854:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906805.776952:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906805.776995:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906805.777021:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906805.778075:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971978368 00000100:00100000:0.0:1787906805.778094:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971978368 00000100:00100000:0.0:1787906805.778214:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971978240 00000100:00100000:0.0:1787906805.778218:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971978240 00000100:00100000:0.0:1787906805.778252:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:0.0:1787906805.778262:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755971978368:12345-192.168.204.20@tcp:400: 00000100:00100000:0.0:1787906805.778369:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755971978368:12345-192.168.204.20@tcp:400: Request processed in 107us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906805.778377:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:0.0:1787906805.778395:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:0.0:1787906805.778401:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755971978240:12345-192.168.204.20@tcp:400: 00000100:00100000:0.0:1787906805.778442:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755971978240:12345-192.168.204.20@tcp:400: Request processed in 41us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906805.778448:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:0.0:1787906805.778470:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971977984 00000100:00100000:0.0:1787906805.778474:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971977984 00000100:00100000:0.0:1787906805.778499:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 165 00000100:00100000:0.0:1787906805.778504:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+8:2343:x1874755971977984:12345-192.168.204.20@tcp:400: 00000100:00100000:0.0:1787906805.778525:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+8:2343:x1874755971977984:12345-192.168.204.20@tcp:400: Request processed in 21us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906805.778531:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 165 00000100:00080000:2.0:1787906805.779214:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787906805.779220:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787906805.784529:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971978112 00000100:00100000:1.0:1787906805.784552:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971978112 00000100:00100000:1.0:1787906805.784724:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:1.0:1787906805.784750:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755971978112:12345-192.168.204.20@tcp:400: 00000100:00100000:1.0:1787906805.784914:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755971978112:12345-192.168.204.20@tcp:400: Request processed in 169us (8101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906805.784923:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00080000:2.0:1787906805.785227:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787906806.433980:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906806.801118:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906806.805305:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971978496 00000100:00100000:1.0:1787906806.805325:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971978496 00000100:00100000:1.0:1787906806.805447:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:1.0:1787906806.805467:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+8:5589:x1874755971978496:12345-192.168.204.20@tcp:101: 00010000:00010000:1.0:1787906806.805486:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906806.805533:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa508210e00/0x72bb6cf063cad2c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef55a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906806.805577:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508210e00/0x72bb6cf063cad2c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef55a expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906806.805590:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa508210e00/0x72bb6cf063cad2c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef55a expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906806.805601:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508210e00, rc 0) 00000100:00100000:1.0:1787906806.805699:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+9:5589:x1874755971978496:12345-192.168.204.20@tcp:101: Request processed in 242us (4710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906806.805706:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:3.0:1787906806.812302:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906806.823940:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971978624 00000100:00100000:0.0:1787906806.823959:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971978624 00000100:00100000:0.0:1787906806.824130:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 167 00000100:00100000:0.0:1787906806.824145:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+9:5589:x1874755971978624:12345-192.168.204.20@tcp:501: 00000100:00100000:0.0:1787906806.828482:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+9:5589:x1874755971978624:12345-192.168.204.20@tcp:501: Request processed in 4330us (16182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906806.828499:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 167 00000100:00100000:2.0:1787906806.835106:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906806.835626:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971978752 00000100:00100000:3.0:1787906806.835647:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971978752 00000100:00100000:3.0:1787906806.836167:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 168 00000100:00100000:3.0:1787906806.836183:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+9:5589:x1874755971978752:12345-192.168.204.20@tcp:503: 00000100:00100000:3.0:1787906806.836884:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+9:5589:x1874755971978752:12345-192.168.204.20@tcp:503: Request processed in 703us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906806.836895:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 168 00000100:00100000:2.0:1787906806.848837:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906806.849180:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971978880 00000100:00100000:0.0:1787906806.849194:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971978880 00000100:00100000:0.0:1787906806.849269:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 169 00000100:00100000:0.0:1787906806.849283:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+9:6081:x1874755971978880:12345-192.168.204.20@tcp:502: 00000100:00100000:0.0:1787906806.851109:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+9:6081:x1874755971978880:12345-192.168.204.20@tcp:502: Request processed in 1809us (2290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906806.851127:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 169 00000100:00100000:1.0:1787906806.858712:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906806.859034:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971979008 00000100:00100000:3.0:1787906806.859045:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971979008 00000100:00100000:3.0:1787906806.859108:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 170 00000100:00100000:3.0:1787906806.859120:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+9:6081:x1874755971979008:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787906806.859503:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+9:6081:x1874755971979008:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 384us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906806.859513:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 170 00000100:00100000:2.0:1787906806.865502:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906806.865769:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971979136 00000100:00100000:0.0:1787906806.865781:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971979136 00000100:00100000:0.0:1787906806.865913:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 171 00000100:00100000:0.0:1787906806.865926:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+9:5589:x1874755971979136:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787906806.865947:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906806.865970:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cad2c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef561 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906806.866007:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cad2c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef561 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906806.866021:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cad2c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef561 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906806.866032:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8ee00, rc 0) 00000100:00100000:0.0:1787906806.866103:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+10:5589:x1874755971979136:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 180us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906806.866110:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 171 00000100:00100000:0.0:1787906806.870201:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906806.870368:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971979264 00000100:00100000:2.0:1787906806.870385:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971979264 00000100:00100000:2.0:1787906806.870493:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 172 00000100:00100000:2.0:1787906806.870506:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:5589:x1874755971979264:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906806.872214:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:5589:x1874755971979264:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 1702us (2022us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787906806.872227:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 172 00010000:00010000:3.0:1787906807.456083:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906807.456090:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000318976:0@lo:400:kworker.0 00000100:00100000:3.0:1787906807.456132:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000319232:0@lo:400:kworker.0 00000100:00100000:1.0:1787906807.456181:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906807.456317:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000318848:0@lo:400:kworker.0 00000100:00100000:3.0:1787906807.462131:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906807.462240:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787906807.462255:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874756000319104:0@lo:400:kworker.0 00000100:00100000:3.0:1787906807.462323:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906807.462417:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000319232 00000100:00100000:3.0:1787906807.462429:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000319232 00000100:00100000:3.0:1787906807.462667:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787906807.462677:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000319232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906807.462744:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000319232:12345-0@lo:400:kworker.0 Request processed in 68us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906807.462751:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787906807.462778:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787906807.462830:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa52efe7100 x1874756000319232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906807.462867:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000319232:0@lo:400:kworker.0 00000100:00100000:3.0:1787906807.462924:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000318976 00000100:00100000:3.0:1787906807.462929:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000318976 00000100:00100000:3.0:1787906807.462954:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000319104 00000100:00100000:3.0:1787906807.462956:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000319104 00000100:00100000:3.0:1787906807.462972:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787906807.462978:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000318976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906807.463010:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000318976:12345-0@lo:400:kworker.0 Request processed in 33us (6831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906807.463015:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787906807.463025:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787906807.463030:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874756000319104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906807.463054:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874756000319104:12345-0@lo:400:kworker.0 Request processed in 24us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906807.463060:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787906807.463074:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906807.463089:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874756000319104:0@lo:400:kworker.0 00000100:00100000:1.0:1787906807.466189:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000318976:0@lo:400:kworker.0 00000100:00100000:0.0:1787906807.466191:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906807.466251:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000319488:0@lo:400:kworker.0 00000100:00100000:3.0:1787906807.466268:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000318848 00000100:00100000:3.0:1787906807.466280:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000318848 00000100:00100000:0.0:1787906807.466287:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874756000319360:0@lo:400:kworker.0 00000100:00100000:1.0:1787906807.466343:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906807.466360:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787906807.466364:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906807.466377:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3301:x1874756000318848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906807.466401:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000319488 00000100:00100000:1.0:1787906807.466406:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000319488 00000100:00100000:3.0:1787906807.466411:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000319360 00000100:00100000:3.0:1787906807.466416:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000319360 00000100:00100000:3.0:1787906807.466463:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787906807.466474:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874756000319360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906807.466482:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787906807.466495:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000319488:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787906807.466525:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787906807.466536:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787906807.466587:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874756000319360:12345-0@lo:400:kworker.0 Request processed in 113us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906807.466596:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787906807.466610:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874756000319360:0@lo:400:kworker.0 00000100:00100000:3.0:1787906807.466675:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3301:x1874756000318848:12345-0@lo:400:kworker.0 Request processed in 301us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906807.466704:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000318848:0@lo:400:kworker.0 00000100:00100000:1.0:1787906807.466856:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000319488:12345-0@lo:400:kworker.0 Request processed in 363us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906807.466864:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787906807.466916:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa52efe5c00 x1874756000319488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906807.466931:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000319488:0@lo:400:kworker.0 00000100:00100000:3.0:1787906807.468122:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787906807.970313:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000319616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787906807.970387:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906807.970705:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000319616 00000100:00100000:2.0:1787906807.970714:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000319616 00000100:00100000:2.0:1787906807.970767:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787906807.970778:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000319616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787906807.971016:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906807.971138:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000319616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 351us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906807.971146:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787906807.974569:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe2a00 x1874756000319616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906807.974613:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000319616:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906808.480258:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787906808.621541:0:8504:0:(class_obd.c:354:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6ec5eaa0 20000000:00000080:1.0:1787906808.621567:0:8504:0:(mgs_handler.c:1205:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8aa53af94400 uarg=0000000000000000 20000000:01000000:1.0:1787906808.621605:0:8504:0:(mgs_llog.c:6200:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787906808.621610:0:8504:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787906808.621615:0:8504:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787906808.631089:0:8505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787906808.631286:0:8504:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787906808.645565:0:8504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787906808.645625:0:8504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787906808.645697:0:8504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787906808.645715:0:8504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787906808.645736:0:8504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906808.645753:0:8504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa500030200/0x72bb6cf063cad043 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad03c expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906808.645762:0:8504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa542174600/0x72bb6cf063cad0a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad09e expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906808.645770:0:8504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad170 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad169 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906808.645779:0:8504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa511995800/0x72bb6cf063cad22d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef529 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906808.645797:0:8504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906808.645894:0:8504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa511995800/0x72bb6cf063cad22d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef529 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906808.645911:0:8504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa511995800/0x72bb6cf063cad22d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef529 expref: 9 pid: 5823 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906808.645927:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874756000319744:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906808.646035:0:8504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad169 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906808.646044:0:8504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad170 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad169 expref: 18 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906808.646054:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874756000319872:0@lo:104: 00000100:00100000:0.0:1787906808.646095:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787906808.646147:0:8504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa542174600/0x72bb6cf063cad0a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad09e expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906808.646155:0:8504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa542174600/0x72bb6cf063cad0a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad09e expref: 18 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906808.646164:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874756000320000:0@lo:104: 00000100:00100000:0.0:1787906808.646186:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787906808.646207:0:8504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa500030200/0x72bb6cf063cad043 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad03c expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906808.646225:0:8504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa500030200/0x72bb6cf063cad043 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad03c expref: 18 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906808.646234:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874756000320128:0@lo:104: 00000100:00100000:0.0:1787906808.646255:0:8504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a29cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787906808.647171:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787906808.647196:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906808.647225:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000319872 00000100:00100000:2.0:1787906808.647232:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000319872 00000100:00100000:3.0:1787906808.648655:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000320000 00000100:00100000:3.0:1787906808.648664:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000320000 00000100:00100000:3.0:1787906808.648693:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000320128 00000100:00100000:3.0:1787906808.648695:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000320128 00000100:00100000:3.0:1787906808.648711:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787906808.648720:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+5:8504:x1874756000319872:12345-0@lo:104: 00010000:00010000:3.0:1787906808.648737:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad170 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.648829:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787906808.648836:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+5:8504:x1874756000319872:12345-0@lo:104: Request processed in 118us (2741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906808.648844:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787906808.648864:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787906808.648870:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534589050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:8504:x1874756000320000:12345-0@lo:104: 00010000:00010000:3.0:1787906808.648878:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad0a5 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.648912:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787906808.648918:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534589050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:8504:x1874756000320000:12345-0@lo:104: Request processed in 48us (2731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906808.648938:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787906808.648974:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787906808.648980:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:8504:x1874756000320128:12345-0@lo:104: 00010000:00010000:3.0:1787906808.648988:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa5421faa00/0x72bb6cf063cad03c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad043 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649019:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787906808.649024:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:8504:x1874756000320128:12345-0@lo:104: Request processed in 45us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906808.649029:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787906808.649052:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787906808.649059:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad170 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649066:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210600 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906808.649071:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad170 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649079:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad170 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906808.649087:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad170 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906808.649093:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787906808.649141:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad170 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649148:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906808.649174:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad170 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649192:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa508210600/0x72bb6cf063cad169 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad170 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649369:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787906808.649373:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad0a5 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649380:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fb000 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906808.649383:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad0a5 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649390:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad0a5 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906808.649396:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad0a5 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906808.649401:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787906808.649416:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0a5 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649422:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906808.649435:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0a5 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649452:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb000/0x72bb6cf063cad09e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad0a5 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649463:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787906808.649471:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa5421faa00/0x72bb6cf063cad03c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad043 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649476:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421faa00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906808.649479:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa5421faa00/0x72bb6cf063cad03c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad043 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649485:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa5421faa00/0x72bb6cf063cad03c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad043 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906808.649491:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa5421faa00/0x72bb6cf063cad03c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad043 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906808.649495:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787906808.649510:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa5421faa00/0x72bb6cf063cad03c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad043 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649515:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906808.649521:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa5421faa00/0x72bb6cf063cad03c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad043 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649528:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa5421faa00/0x72bb6cf063cad03c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad043 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.649542:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906808.649543:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906808.649545:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906808.649553:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906808.650509:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906808.650521:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787906808.650541:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000320256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787906808.652271:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000320384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787906808.654887:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906808.654965:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000320512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787906808.655005:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906808.655126:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000320256 00000100:00100000:2.0:1787906808.655136:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000320256 00010000:00010000:2.0:1787906808.655174:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad170 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad169 expref: 19 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906808.655209:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000320512 00000100:00100000:2.0:1787906808.655212:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000320512 00010000:00010000:2.0:1787906808.655224:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa500030200/0x72bb6cf063cad043 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad03c expref: 20 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906808.655240:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787906808.655252:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+20:3303:x1874756000320256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787906808.655267:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906808.655286:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad170 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad169 expref: 20 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.655298:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad170 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad169 expref: 20 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906808.655317:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906808.655353:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+20:3303:x1874756000320256:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906808.655604:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906808.655668:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874756000319744:192.168.204.20@tcp:104: 00010000:00010000:1.0:1787906808.655681:0:8504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad170 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad169 expref: 20 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906808.655694:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874756000319872:0@lo:104: 00000100:00100000:1.0:1787906808.655704:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874756000320000:0@lo:104: 00000100:00100000:1.0:1787906808.655711:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874756000320128:0@lo:104: 00010000:00010000:1.0:1787906808.655734:0:8504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906808.657912:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906808.657954:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787906808.657965:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787906808.658138:0:5815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787906808.658150:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000320384 00000100:00100000:2.0:1787906808.658170:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000320384 00010000:00010000:2.0:1787906808.658203:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa542174600/0x72bb6cf063cad0a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad09e expref: 20 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906808.658227:0:5815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787906808.658234:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971979392 00000100:00100000:2.0:1787906808.658237:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971979392 00010000:00010000:2.0:1787906808.658248:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa511995800/0x72bb6cf063cad22d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef529 expref: 10 pid: 5823 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906808.658260:0:5815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787906808.658268:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787906808.658276:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+20:3302:x1874756000320512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787906808.658289:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906808.658295:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa500030200/0x72bb6cf063cad043 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad03c expref: 20 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658305:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa500030200/0x72bb6cf063cad043 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad03c expref: 20 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658322:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa500030200/0x72bb6cf063cad043 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad03c expref: 20 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658337:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906808.658449:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3302:x1874756000320512:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (3442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906808.658457:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787906808.658477:0:5815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787906808.658483:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787906808.658489:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:3301:x1874756000320384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787906808.658505:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906808.658510:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa542174600/0x72bb6cf063cad0a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad09e expref: 18 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658518:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa542174600/0x72bb6cf063cad0a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad09e expref: 18 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658528:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa542174600/0x72bb6cf063cad0a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad09e expref: 18 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658537:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906808.658571:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:3301:x1874756000320384:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (2966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906808.658577:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787906808.658588:0:5815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787906808.658595:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:2.0:1787906808.658601:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9eec00eb-d19d-4892-ad44-299469e66291+10:2346:x1874755971979392:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906808.658610:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906808.658615:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa511995800/0x72bb6cf063cad22d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef529 expref: 10 pid: 5823 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658624:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa511995800/0x72bb6cf063cad22d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef529 expref: 10 pid: 5823 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658647:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511995800/0x72bb6cf063cad22d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef529 expref: 10 pid: 5823 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658660:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658678:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658693:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658699:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658705:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658711:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658717:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e000 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787906808.658721:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658729:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906808.658743:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906808.659597:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787906808.659891:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000320384:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787906808.659926:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906808.659987:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9eec00eb-d19d-4892-ad44-299469e66291+9:2346:x1874755971979392:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 1384us (2081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906808.659996:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:0.0:1787906808.660142:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000320256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787906808.661060:0:8504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906808.661073:0:8504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906808.661079:0:8504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa53ac8e000/0x72bb6cf063cad2ce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906808.674165:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000320512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787906809.517259:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906810.072306:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906810.072377:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971979520 00000100:00100000:0.0:1787906810.072388:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971979520 00000100:00100000:0.0:1787906810.072447:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 174 00000100:00100000:0.0:1787906810.072458:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+9:5589:x1874755971979520:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787906810.072478:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906810.072506:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad2d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef568 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906810.072537:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad2d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef568 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906810.072549:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad2d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef568 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906810.072571:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f200, rc 0) 00000100:00100000:0.0:1787906810.072647:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+10:5589:x1874755971979520:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 190us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906810.072654:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 174 00000100:00100000:3.0:1787906810.075308:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906810.075945:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971979648 00000100:00100000:0.0:1787906810.075955:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971979648 00000100:00100000:0.0:1787906810.076006:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:0.0:1787906810.076016:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:5589:x1874755971979648:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787906810.083016:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:5589:x1874755971979648:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 6986us (7702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906810.083034:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:1.0:1787906810.085610:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906810.085770:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971979776 00000100:00100000:3.0:1787906810.085783:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971979776 00000100:00100000:3.0:1787906810.085865:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 176 00000100:00100000:3.0:1787906810.085877:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:5589:x1874755971979776:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787906810.086357:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:5589:x1874755971979776:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 481us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906810.086366:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 176 00000100:00100000:3.0:1787906810.094674:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906810.094799:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971979904 00000100:00100000:0.0:1787906810.094848:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971979904 00000100:00100000:0.0:1787906810.094897:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 177 00000100:00100000:0.0:1787906810.094907:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:6138:x1874755971979904:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787906810.095193:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:6138:x1874755971979904:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 285us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906810.095202:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 177 00000100:00100000:1.0:1787906810.108602:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906810.110633:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971980032 00000100:00100000:3.0:1787906810.110653:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971980032 00000100:00100000:3.0:1787906810.110752:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 178 00000100:00100000:3.0:1787906810.110764:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:6138:x1874755971980032:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787906810.111164:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:6138:x1874755971980032:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 400us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906810.111184:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 178 10000000:01000000:2.0:1787906810.274432:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787906810.274442:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa401350800 from 4 10000000:01000000:2.0:1787906810.274447:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787906810.274515:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.274529:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.274539:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906810.274565:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000320640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.274641:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906810.274685:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50630b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787906810.274707:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000320640 00000100:00100000:2.0:1787906810.274714:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000320640 00000100:00100000:2.0:1787906810.274766:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787906810.274775:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000320640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787906810.274787:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906810.274798:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cad2e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad2dc expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.274838:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cad2e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad2dc expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.274848:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cad2e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad2dc expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.274857:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96600, rc 0) 00000100:00100000:2.0:1787906810.274905:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000320640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906810.274912:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787906810.274954:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000320640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787906810.274967:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.274976:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad2e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906810.275020:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000320768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.275040:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906810.275052:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50630b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787906810.275063:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000320768 00000100:00100000:2.0:1787906810.275066:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000320768 00000100:00100000:2.0:1787906810.275083:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787906810.275104:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000320768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.277058:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000320768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1948us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906810.277071:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787906810.277150:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000320768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.277198:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000320896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.277245:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906810.277289:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50f365840 going to sleep for 11 seconds 00000100:00100000:2.0:1787906810.277304:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000320896 00000100:00100000:2.0:1787906810.277310:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000320896 00000100:00100000:2.0:1787906810.277352:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787906810.277360:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000320896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.285957:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000320896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 8585us (8699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906810.285975:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787906810.286062:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000320896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.286645:0:8541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8541:1874756000321024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906810.286701:0:8541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906810.287381:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000321024 00000100:00100000:2.0:1787906810.287391:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000321024 00000100:00100000:2.0:1787906810.287441:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787906810.287451:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:8541:x1874756000321024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906810.287976:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:8541:x1874756000321024:12345-0@lo:502:llog_process_th.0 Request processed in 524us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906810.287985:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787906810.288048:0:8541:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50f365840 going to sleep for 11 seconds 00000100:00100000:2.0:1787906810.288069:0:8541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8541:1874756000321024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787906810.288111:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787906810.288121:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906810.288123:0:8541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787906810.288131:0:8541:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa401350800 00000020:00000080:2.0:1787906810.288134:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787906810.290248:0:8541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8541:1874756000321152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787906810.299988:0:8541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906810.300065:0:8541:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a29900 going to sleep for 11 seconds 00000100:00100000:2.0:1787906810.305107:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000321152 00000100:00100000:2.0:1787906810.305127:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000321152 00000100:00100000:2.0:1787906810.305190:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787906810.305200:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:8541:x1874756000321152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906810.305512:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:8541:x1874756000321152:12345-0@lo:502:llog_process_th.0 Request processed in 312us (5533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906810.305521:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787906810.305602:0:8541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8541:1874756000321152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787906810.305648:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787906810.305658:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906810.305661:0:8541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787906810.305669:0:8541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787906810.310880:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787906810.310921:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787906810.310935:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.310948:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906810.310960:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787906810.310963:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa510341800 from 4 10000000:01000000:2.0:1787906810.310966:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787906810.311004:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.311011:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.311021:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906810.311046:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000321280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.311139:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906810.311182:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa517294f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906810.311204:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000321280 00000100:00100000:2.0:1787906810.311211:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000321280 00000100:00100000:2.0:1787906810.311266:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787906810.311277:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000321280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787906810.311290:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906810.311302:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa541c96c00/0x72bb6cf063cad2f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad2ea expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.311325:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c96c00/0x72bb6cf063cad2f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad2ea expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.311335:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa541c96c00/0x72bb6cf063cad2f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad2ea expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.311343:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96c00, rc 0) 00000100:00100000:2.0:1787906810.311385:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000321280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906810.311393:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787906810.311441:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000321280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787906810.311455:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.311464:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad2f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906810.314538:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000321408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.315035:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906810.325038:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000321408 00000100:00100000:2.0:1787906810.325056:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000321408 00000100:00100000:2.0:1787906810.325128:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787906810.325139:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000321408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.325439:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000321408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (10404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906810.325447:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787906810.325493:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa517294f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906810.325530:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000321408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.325580:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000321536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.325912:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906810.325938:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000321536 00000100:00100000:2.0:1787906810.325942:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000321536 00000100:00100000:2.0:1787906810.325967:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787906810.325974:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000321536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.326149:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000321536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906810.326155:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787906810.326188:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa517294f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906810.326202:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000321536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.328425:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8545:1874756000321664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906810.329362:0:8545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906810.329415:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa517294c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787906810.329957:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000321664 00000100:00100000:3.0:1787906810.329967:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000321664 00000100:00100000:3.0:1787906810.330016:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787906810.330026:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:8545:x1874756000321664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906810.332375:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8545:1874756000321664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787906810.332433:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787906810.332445:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906810.332447:0:8545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787906810.332455:0:8545:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa510341800 00000020:00000080:2.0:1787906810.332457:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787906810.332790:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:8545:x1874756000321664:12345-0@lo:502:llog_process_th.0 Request processed in 2763us (3428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906810.332803:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787906810.333300:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8545:1874756000321792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906810.333367:0:8545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906810.333401:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000321792 00000100:00100000:2.0:1787906810.333408:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000321792 00000100:00100000:2.0:1787906810.333448:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787906810.333458:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:8545:x1874756000321792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787906810.338889:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50630b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787906810.339276:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:8545:x1874756000321792:12345-0@lo:502:llog_process_th.0 Request processed in 5812us (5902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906810.339289:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787906810.339926:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8545:1874756000321792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787906810.339965:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787906810.339974:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787906810.339976:0:8545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787906810.339982:0:8545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787906810.340983:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787906810.341014:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787906810.341027:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.341039:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906810.341049:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787906810.341052:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa51a4db800 from 4 10000000:01000000:2.0:1787906810.341055:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787906810.341105:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.341114:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.341133:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906810.341163:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000321920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.341240:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906810.343452:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50a3cc780 going to sleep for 11 seconds 00000100:00100000:2.0:1787906810.343490:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000321920 00000100:00100000:2.0:1787906810.343508:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000321920 00000100:00100000:2.0:1787906810.343566:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787906810.343575:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000321920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787906810.343591:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906810.343619:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa541c96200/0x72bb6cf063cad2ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad2f8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.345440:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c96200/0x72bb6cf063cad2ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad2f8 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.345455:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa541c96200/0x72bb6cf063cad2ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad2f8 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.345464:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96200, rc 0) 00000100:00100000:2.0:1787906810.346309:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000321920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2730us (5064us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906810.346319:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787906810.346419:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000321920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787906810.346444:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2ff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.346467:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad2ff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906810.346541:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000322048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.346573:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906810.346598:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50a3cc780 going to sleep for 11 seconds 00000100:00100000:2.0:1787906810.346613:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000322048 00000100:00100000:2.0:1787906810.346620:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000322048 00000100:00100000:2.0:1787906810.346652:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787906810.346660:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000322048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.346916:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000322048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906810.346923:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787906810.347030:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000322048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.347059:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000322176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.347277:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906810.347293:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa520a1d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787906810.347307:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000322176 00000100:00100000:2.0:1787906810.347310:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000322176 00000100:00100000:2.0:1787906810.347333:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787906810.347339:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000322176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.347478:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000322176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906810.347485:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787906810.347532:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000322176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906810.360422:0:8547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8547:1874756000322304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906810.360517:0:8547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906810.360564:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000322304 00000100:00100000:2.0:1787906810.360571:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000322304 00000100:00100000:2.0:1787906810.360612:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787906810.360622:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:8547:x1874756000322304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906810.361013:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:8547:x1874756000322304:12345-0@lo:502:llog_process_th.0 Request processed in 391us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906810.361021:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787906810.361079:0:8547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa520a1d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787906810.361113:0:8547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8547:1874756000322304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787906810.361142:0:8547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787906810.361152:0:8547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906810.361154:0:8547:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787906810.361162:0:8547:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa51a4db800 00000020:00000080:2.0:1787906810.361164:0:8547:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787906810.361532:0:8547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8547:1874756000322432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906810.361572:0:8547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906810.361595:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000322432 00000100:00100000:2.0:1787906810.361600:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000322432 00000100:00100000:2.0:1787906810.361626:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787906810.361633:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:8547:x1874756000322432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906810.363346:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:8547:x1874756000322432:12345-0@lo:502:llog_process_th.0 Request processed in 1704us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906810.363360:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787906810.363431:0:8547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa520a1d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787906810.363456:0:8547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:8547:1874756000322432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787906810.363490:0:8547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787906810.366122:0:8547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787906810.366125:0:8547:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787906810.366134:0:8547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787906810.366220:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787906810.366241:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787906810.369034:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2ff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906810.369057:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2ff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906810.528578:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000322560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787906810.528669:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906810.528869:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000322560 00000100:00100000:1.0:1787906810.528880:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000322560 00000100:00100000:1.0:1787906810.528948:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787906810.528959:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000322560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787906810.528993:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787906810.542452:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787906810.545837:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000322560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 16857us (17144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906810.545852:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787906810.546841:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53aca3800 x1874756000322560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906810.546874:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000322560:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787906810.546968:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906810.891239:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906810.891285:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906810.891320:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906810.891351:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906810.891398:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971980288 00000100:00100000:1.0:1787906810.891409:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971980288 00000100:00100000:1.0:1787906810.891494:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:1.0:1787906810.891508:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755971980288:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906810.891613:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755971980288:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 109us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906810.891621:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:1.0:1787906810.891648:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971980544 00000100:00100000:1.0:1787906810.891651:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971980544 00000100:00100000:1.0:1787906810.891680:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971980416 00000100:00100000:1.0:1787906810.891683:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971980416 00000100:00100000:1.0:1787906810.891705:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:1.0:1787906810.891712:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755971980544:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906810.891740:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755971980544:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906810.891747:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:1.0:1787906810.891759:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:1.0:1787906810.891765:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755971980416:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906810.891790:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755971980416:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906810.891832:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:1.0:1787906810.891854:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971980160 00000100:00100000:1.0:1787906810.891858:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971980160 00000100:00100000:1.0:1787906810.891882:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 194 00000100:00100000:1.0:1787906810.891889:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:2343:x1874755971980160:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906810.891915:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:2343:x1874755971980160:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906810.891921:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 194 00000100:00080000:1.0:1787906810.891953:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787906810.891958:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787906810.891961:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787906811.552248:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906812.576080:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787906812.576108:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000323072:0@lo:400:kworker.0 00010000:00010000:3.0:1787906812.576182:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906812.576190:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906812.576256:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000322688:0@lo:400:kworker.0 00000100:00100000:0.0:1787906812.576285:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906812.576305:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787906812.576311:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000323200:0@lo:400:kworker.0 00000100:00100000:0.0:1787906812.576335:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906812.576381:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000323200 00000100:00100000:0.0:1787906812.576391:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000323200 00000100:00100000:1.0:1787906812.576731:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000322816:0@lo:400:kworker.0 00000100:00100000:1.0:1787906812.576768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906812.576794:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000323328:0@lo:400:kworker.0 00000100:00100000:1.0:1787906812.576835:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906812.576852:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906812.576858:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000322944:0@lo:400:kworker.0 00000100:00100000:1.0:1787906812.576879:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906812.576953:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000322816 00000100:00100000:0.0:1787906812.576958:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000322816 00000100:00100000:0.0:1787906812.576973:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000322944 00000100:00100000:0.0:1787906812.576975:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000322944 00000100:00100000:0.0:1787906812.576993:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787906812.577003:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000323200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906812.577074:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000323200:12345-0@lo:400:kworker.0 Request processed in 72us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906812.577083:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787906812.577099:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787906812.577105:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000322816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906812.577132:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000322816:12345-0@lo:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906812.577156:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787906812.577168:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787906812.577173:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000322944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906812.577201:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000322944:12345-0@lo:400:kworker.0 Request processed in 28us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906812.577206:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787906812.577241:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000323200:0@lo:400:kworker.0 00000100:00080000:0.0:1787906812.577282:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906812.577625:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000322688 00000100:00100000:2.0:1787906812.577630:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000322688 00000100:00100000:1.0:1787906812.580859:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000323072 00000100:00100000:1.0:1787906812.580879:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000323072 00000100:00100000:1.0:1787906812.580949:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000323328 00000100:00100000:1.0:1787906812.580953:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000323328 00000100:00100000:1.0:1787906812.580981:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787906812.580994:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000323072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906812.581113:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000323072:12345-0@lo:400:kworker.0 Request processed in 122us (4922us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906812.581135:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787906812.581151:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787906812.581157:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000323328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906812.581188:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000323328:12345-0@lo:400:kworker.0 Request processed in 32us (4353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906812.581194:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787906812.581235:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000322944:0@lo:400:kworker.0 00000100:00100000:1.0:1787906812.581249:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000322816:0@lo:400:kworker.0 00010000:00080000:1.0:1787906812.581263:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe2a00 x1874756000323328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906812.581273:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000323328:0@lo:400:kworker.0 00000100:00080000:3.0:1787906812.581274:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787906812.581279:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787906812.581304:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe2300 x1874756000323072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906812.581323:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000323072:0@lo:400:kworker.0 00000100:00100000:2.0:1787906812.584085:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787906812.584126:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000322688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906812.584294:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000322688:12345-0@lo:400:kworker.0 Request processed in 188us (8006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906812.584302:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787906812.586261:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000322688:0@lo:400:kworker.0 00000100:00100000:0.0:1787906813.088112:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787906813.088142:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000323456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787906813.088243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906813.088370:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000323456 00000100:00100000:3.0:1787906813.088383:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000323456 00000100:00100000:3.0:1787906813.088446:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787906813.088457:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000323456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787906813.088498:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906813.088551:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000323456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906813.088558:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787906813.088598:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe2300 x1874756000323456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906813.088616:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000323456:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787906813.608291:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906814.625719:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906815.648300:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000323584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906815.648400:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906815.648512:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000323584 00000100:00100000:2.0:1787906815.648522:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000323584 00000100:00100000:2.0:1787906815.648598:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787906815.648610:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000323584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787906815.648676:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906815.648736:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000323584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906815.648745:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1787906815.648772:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787906815.648810:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53aca0a80 x1874756000323584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906815.648862:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000323584:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787906815.649184:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906816.017791:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906816.017864:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906816.017915:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971980928 00000100:00100000:3.0:1787906816.017933:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971980928 00000100:00100000:3.0:1787906816.018028:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971981056 00000100:00100000:3.0:1787906816.018031:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971981056 00000100:00100000:3.0:1787906816.018063:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:3.0:1787906816.018077:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2342:x1874755971980928:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:3.0:1787906816.018131:0:6674:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad23b 00000100:00080000:3.0:1787906816.018148:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8aa510325000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787906816.018331:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787906816.018770:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906816.019236:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1787906816.019262:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2342:x1874755971981056:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:2.0:1787906816.019304:0:6673:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad242 00000100:00080000:2.0:1787906816.019318:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8aa510327800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787906816.019370:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787906816.019777:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+2:2342:x1874755971981056:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 526us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906816.019788:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00080000:2.0:1787906816.019859:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787906816.019865:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787906816.019999:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906816.020152:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906816.020193:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971980672 00000100:00100000:2.0:1787906816.020204:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971980672 00000100:00100000:2.0:1787906816.020253:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 196 00000100:00100000:2.0:1787906816.020261:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:2345:x1874755971980672:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906816.020307:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:2345:x1874755971980672:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 46us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906816.020341:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 196 00000100:00100000:0.0:1787906816.021682:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971980800 00000100:00100000:0.0:1787906816.021705:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971980800 00000100:00100000:0.0:1787906816.021808:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:0.0:1787906816.021836:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755971980800:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906816.021933:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755971980800:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 101us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906816.022260:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00080000:0.0:1787906816.022310:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906816.023505:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+2:2342:x1874755971980928:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 5421us (5724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906816.023533:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00010000:00010000:3.0:1787906816.023884:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906816.675295:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787906816.802328:0:6699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 419aebcc-abec-417c-9cd3-22c347ab3c27 00000020:00000080:1.0:1787906816.802343:0:6699:0:(genops.c:885:class_export_put()) final put ffff8aa510321000/419aebcc-abec-417c-9cd3-22c347ab3c27 00000020:00000080:1.0:1787906816.802380:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa510321000/419aebcc-abec-417c-9cd3-22c347ab3c27 for lustre-OST0000 00000020:00000080:1.0:1787906816.802446:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa510325000 for lustre-OST0000 00000001:02000400:0.0:1787906817.494782:0:8806:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1787906817.696278:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000324096:0@lo:400:kworker.0 00000100:00100000:3.0:1787906817.696356:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906817.697693:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787906817.697711:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000323712:0@lo:400:kworker.0 00000100:00100000:3.0:1787906817.697777:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906817.697840:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000324224:0@lo:400:kworker.0 00000100:00100000:3.0:1787906817.697872:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906817.697910:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000323840:0@lo:400:kworker.0 00000100:00100000:3.0:1787906817.697935:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906817.697972:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000324352:0@lo:400:kworker.0 00000100:00100000:3.0:1787906817.697996:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906817.698019:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787906817.698025:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000323968:0@lo:400:kworker.0 00000100:00100000:3.0:1787906817.698073:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787906817.698110:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906817.698125:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000324224 00000100:00100000:3.0:1787906817.698132:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000324224 00000100:00100000:3.0:1787906817.698182:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000323840 00000100:00100000:3.0:1787906817.698185:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000323840 00000100:00100000:3.0:1787906817.698197:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000323968 00000100:00100000:3.0:1787906817.698200:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000323968 00000100:00100000:3.0:1787906817.698219:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787906817.698229:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000324224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906817.698286:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000324224:12345-0@lo:400:kworker.0 Request processed in 58us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906817.698299:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787906817.698319:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787906817.698325:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000323840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906817.698360:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000323840:12345-0@lo:400:kworker.0 Request processed in 35us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906817.698366:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787906817.698378:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787906817.698384:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000323968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906817.698711:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000323712 00000100:00100000:1.0:1787906817.698718:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000323712 00000100:00100000:1.0:1787906817.698755:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787906817.698762:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000323712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906817.698801:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000323712:12345-0@lo:400:kworker.0 Request processed in 40us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906817.698807:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787906817.698930:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000324096 00000100:00100000:2.0:1787906817.698936:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000324096 00000100:00100000:2.0:1787906817.698990:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000324352 00000100:00100000:2.0:1787906817.698994:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000324352 00000100:00100000:2.0:1787906817.699022:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787906817.699029:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000324096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906817.699073:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000324096:12345-0@lo:400:kworker.0 Request processed in 45us (2717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906817.699080:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787906817.699092:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787906817.699099:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000324352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906817.699129:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000324352:12345-0@lo:400:kworker.0 Request processed in 31us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906817.699135:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787906817.699313:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000323968:12345-0@lo:400:kworker.0 Request processed in 928us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906817.699320:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787906817.699348:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787906817.699352:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787906817.699354:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906817.699389:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000323968:0@lo:400:kworker.0 00000100:00100000:2.0:1787906817.699723:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000323712:0@lo:400:kworker.0 00000100:00100000:2.0:1787906817.699742:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000324224:0@lo:400:kworker.0 00010000:00080000:2.0:1787906817.699761:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe0a80 x1874756000324096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906817.699772:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000324096:0@lo:400:kworker.0 00000100:00100000:3.0:1787906817.699956:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000323840:0@lo:400:kworker.0 00010000:00080000:3.0:1787906817.699971:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510213800 x1874756000324352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906817.699980:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000324352:0@lo:400:kworker.0 00000100:00100000:2.0:1787906818.208071:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787906818.208098:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000324480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787906818.208179:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906818.208298:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000324480 00000100:00100000:3.0:1787906818.208309:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000324480 00000100:00100000:3.0:1787906818.208384:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787906818.208395:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000324480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787906818.208433:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906818.208520:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000324480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906818.208528:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787906818.208589:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f77800 x1874756000324480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906818.208618:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000324480:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906818.720292:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906819.745249:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787906820.372565:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 419aebcc-abec-417c-9cd3-22c347ab3c27 00000020:00000080:1.0:1787906820.372581:0:7636:0:(genops.c:885:class_export_put()) final put ffff8aa510326000/419aebcc-abec-417c-9cd3-22c347ab3c27 00000020:00000080:3.0:1787906820.372783:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa510326000/419aebcc-abec-417c-9cd3-22c347ab3c27 for lustre-OST0001 00000020:00000080:3.0:1787906820.372903:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa510327800 for lustre-OST0001 00010000:00010000:3.0:1787906820.768761:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906820.769453:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000324608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787906820.770060:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906820.770164:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000324608 00000100:00100000:3.0:1787906820.770175:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000324608 00000100:00100000:3.0:1787906820.770681:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787906820.770695:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000324608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787906820.770742:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906820.770806:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000324608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906820.770831:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787906820.774647:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787906820.774772:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f74a80 x1874756000324608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906820.775395:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000324608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906821.131163:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906821.131530:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971981312 00000100:00100000:3.0:1787906821.131547:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971981312 00000100:00100000:3.0:1787906821.131652:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:3.0:1787906821.131672:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755971981312:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906821.131790:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755971981312:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 122us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906821.131806:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00080000:2.0:1787906821.133164:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906821.136018:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906821.136173:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971981184 00000100:00100000:1.0:1787906821.136188:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971981184 00000100:00100000:1.0:1787906821.136262:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 198 00000100:00100000:1.0:1787906821.136274:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+10:2346:x1874755971981184:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906821.143182:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+10:2346:x1874755971981184:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 6882us (7152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906821.143201:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 198 00010000:00010000:3.0:1787906821.792242:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906822.819543:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906822.819687:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000325120:0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.819790:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906822.819898:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787906822.819905:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000324736:0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.819939:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906822.819964:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000325248:0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.819987:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906822.820014:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000324864:0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.820035:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906822.820067:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000325376:0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.820087:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906822.820105:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906822.820110:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000324992:0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.820128:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906822.820384:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000325120 00000100:00100000:1.0:1787906822.820393:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000325120 00000100:00100000:1.0:1787906822.820453:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000325376 00000100:00100000:1.0:1787906822.820457:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000325376 00000100:00100000:1.0:1787906822.820483:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787906822.820493:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000325120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.820554:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000325120:12345-0@lo:400:kworker.0 Request processed in 62us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906822.820562:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787906822.820577:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787906822.820585:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000325376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.820618:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000325376:12345-0@lo:400:kworker.0 Request processed in 34us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906822.820623:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787906822.820641:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000324736 00000100:00100000:1.0:1787906822.820645:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000324736 00000100:00100000:1.0:1787906822.820668:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787906822.820674:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000324736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.820704:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000324736:12345-0@lo:400:kworker.0 Request processed in 31us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906822.820709:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787906822.820740:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000325248 00000100:00100000:1.0:1787906822.820744:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000325248 00000100:00100000:1.0:1787906822.820764:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000324864 00000100:00100000:1.0:1787906822.820766:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000324864 00000100:00100000:1.0:1787906822.820776:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000324992 00000100:00100000:1.0:1787906822.820778:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000324992 00000100:00100000:1.0:1787906822.820793:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787906822.820800:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000325248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.820883:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000325248:12345-0@lo:400:kworker.0 Request processed in 83us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906822.820889:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787906822.820901:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787906822.820907:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000324864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.820930:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000324864:12345-0@lo:400:kworker.0 Request processed in 24us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906822.822632:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787906822.822670:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787906822.822684:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000324992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.822760:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000324992:12345-0@lo:400:kworker.0 Request processed in 83us (2630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906822.822767:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787906822.822805:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787906822.822825:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787906822.822827:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787906822.822899:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000324992:0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.822914:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000324864:0@lo:400:kworker.0 00010000:00080000:1.0:1787906822.822929:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa52efe7800 x1874756000325376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906822.823678:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000325376:0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.823804:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000324736:0@lo:400:kworker.0 00000100:00100000:1.0:1787906822.823856:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000325248:0@lo:400:kworker.0 00010000:00080000:1.0:1787906822.823892:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa52efe5500 x1874756000325120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906822.823902:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000325120:0@lo:400:kworker.0 00000100:00100000:0.0:1787906823.328988:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000325504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787906823.329058:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906823.329167:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000325504 00000100:00100000:3.0:1787906823.329176:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000325504 00000100:00100000:3.0:1787906823.329231:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787906823.329242:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000325504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787906823.329283:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906823.329331:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000325504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906823.329338:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787906823.329409:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f74a80 x1874756000325504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906823.329427:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000325504:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787906823.461869:0:9054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing yml_node 00010000:00010000:2.0:1787906823.841056:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906824.873698:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906825.888134:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906825.888220:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787906825.888245:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000325632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906825.888342:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906825.888581:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000325632 00000100:00100000:3.0:1787906825.888592:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000325632 00000100:00100000:3.0:1787906825.888672:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787906825.888685:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000325632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787906825.888735:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906825.888804:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000325632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906825.888834:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787906825.888875:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f76300 x1874756000325632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906825.888897:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000325632:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787906825.889211:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787906826.252471:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906826.252530:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906826.252706:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971981440 00000100:00100000:2.0:1787906826.252720:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971981440 00000100:00100000:0.0:1787906826.252792:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971981568 00000100:00100000:0.0:1787906826.252796:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971981568 00000100:00100000:2.0:1787906826.252862:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 200 00000100:00100000:2.0:1787906826.252873:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:2344:x1874755971981440:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906826.252874:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:0.0:1787906826.252880:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2344:x1874755971981568:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906826.252945:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:2344:x1874755971981440:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 74us (484us total) trans 0 rc 0/0 00000100:00080000:3.0:1787906826.252948:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906826.252953:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 200 00000100:00100000:0.0:1787906826.261660:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2344:x1874755971981568:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 8762us (9111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906826.261681:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00010000:00010000:2.0:1787906826.914414:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906827.936138:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906827.936572:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000326016:0@lo:400:kworker.0 00000100:00100000:3.0:1787906827.936661:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906827.936756:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787906827.936763:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000325888:0@lo:400:kworker.0 00000100:00100000:3.0:1787906827.936797:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906827.936851:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000326400:0@lo:400:kworker.0 00000100:00100000:3.0:1787906827.936877:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906827.936920:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000326400 00000100:00100000:3.0:1787906827.936930:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000326400 00000100:00100000:3.0:1787906827.936994:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787906827.937005:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000326400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906827.937059:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000326400:12345-0@lo:400:kworker.0 Request processed in 56us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906827.937067:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787906827.937088:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000326016 00000100:00100000:3.0:1787906827.937093:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000326016 00000100:00100000:3.0:1787906827.937118:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000325888 00000100:00100000:3.0:1787906827.937120:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000325888 00000100:00100000:3.0:1787906827.937136:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787906827.937142:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000326016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906827.937175:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000326016:12345-0@lo:400:kworker.0 Request processed in 33us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906827.937181:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787906827.937193:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787906827.937199:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000325888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906827.937253:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000325888:12345-0@lo:400:kworker.0 Request processed in 54us (455us total) trans 0 rc 0/0 00000100:00080000:0.0:1787906827.937258:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906827.937262:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1787906827.937272:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787906827.937308:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000325888:0@lo:400:kworker.0 00010000:00080000:3.0:1787906827.937324:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f75880 x1874756000326400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906827.937335:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000326400:0@lo:400:kworker.0 00000100:00100000:3.0:1787906827.937345:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000326016:0@lo:400:kworker.0 00000100:00100000:2.0:1787906827.937563:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000325760:0@lo:400:kworker.0 00000100:00100000:2.0:1787906827.937614:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906827.937655:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000326272:0@lo:400:kworker.0 00000100:00100000:2.0:1787906827.937679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906827.937704:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787906827.937710:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000326144:0@lo:400:kworker.0 00000100:00100000:2.0:1787906827.937733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906827.937848:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000326272 00000100:00100000:1.0:1787906827.937853:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000326272 00000100:00100000:1.0:1787906827.937898:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787906827.937906:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000326272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906827.937953:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000326272:12345-0@lo:400:kworker.0 Request processed in 49us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906827.937961:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787906827.937981:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000326144 00000100:00100000:1.0:1787906827.937985:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000326144 00000100:00100000:1.0:1787906827.938013:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787906827.938018:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000326144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906827.938052:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000326144:12345-0@lo:400:kworker.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906827.938057:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787906827.938177:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787906827.938182:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787906827.938206:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f74700 x1874756000326144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906827.938217:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000326144:0@lo:400:kworker.0 00000100:00100000:2.0:1787906827.938243:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000326272:0@lo:400:kworker.0 00000100:00100000:0.0:1787906827.940701:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000325760 00000100:00100000:0.0:1787906827.940760:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000325760 00000100:00100000:0.0:1787906827.940926:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787906827.940951:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000325760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906827.941282:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000325760:12345-0@lo:400:kworker.0 Request processed in 341us (3665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906827.941293:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787906827.944845:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000325760:0@lo:400:kworker.0 00000100:00100000:2.0:1787906828.448222:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787906828.448251:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000326528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787906828.448335:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906828.448849:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000326528 00000100:00100000:3.0:1787906828.448859:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000326528 00000100:00100000:3.0:1787906828.448929:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787906828.448941:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000326528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787906828.448981:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906828.449100:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000326528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906828.449108:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787906828.450797:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f75180 x1874756000326528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906828.450838:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000326528:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906828.959987:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787906829.524164:0:9247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.85 00010000:00010000:1.0:1787906829.984451:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906831.008175:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906831.008518:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000326656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787906831.008722:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906831.009618:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000326656 00000100:00100000:3.0:1787906831.009642:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000326656 00000100:00100000:3.0:1787906831.009758:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787906831.009769:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000326656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787906831.009867:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906831.009972:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000326656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 204us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906831.010002:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787906831.010496:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787906831.011257:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f75880 x1874756000326656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906831.011289:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000326656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906831.369973:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906831.370084:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906831.370202:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971981696 00000100:00100000:1.0:1787906831.370213:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971981696 00000100:00100000:1.0:1787906831.370298:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 202 00000100:00100000:1.0:1787906831.370312:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:2345:x1874755971981696:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906831.370422:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:2345:x1874755971981696:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 113us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906831.370430:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 202 00000100:00100000:3.0:1787906831.371373:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971981824 00000100:00100000:3.0:1787906831.371382:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971981824 00000100:00080000:2.0:1787906831.371623:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906831.373036:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:3.0:1787906831.373056:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755971981824:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906831.373157:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755971981824:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 108us (3072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906831.373165:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00010000:00010000:3.0:1787906832.036960:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787906832.852327:0:9344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.85 00010000:00010000:3.0:1787906833.057905:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906833.058456:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000326784:0@lo:400:kworker.0 00000100:00100000:1.0:1787906833.058532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906833.058624:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000327296:0@lo:400:kworker.0 00000100:00100000:1.0:1787906833.058663:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906833.058690:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787906833.058696:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000327168:0@lo:400:kworker.0 00000100:00100000:1.0:1787906833.058722:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906833.058756:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000326912:0@lo:400:kworker.0 00000100:00100000:1.0:1787906833.058780:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906833.058799:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000327424:0@lo:400:kworker.0 00000100:00100000:1.0:1787906833.058842:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906833.058861:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906833.058866:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000327040:0@lo:400:kworker.0 00000100:00100000:1.0:1787906833.058889:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906833.058932:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000327296 00000100:00100000:1.0:1787906833.058941:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000327296 00000100:00100000:1.0:1787906833.059000:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000326912 00000100:00100000:1.0:1787906833.059003:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000326912 00000100:00100000:1.0:1787906833.059017:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000327040 00000100:00100000:1.0:1787906833.059019:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000327040 00000100:00100000:1.0:1787906833.059038:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787906833.059056:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000327296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906833.059119:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000327296:12345-0@lo:400:kworker.0 Request processed in 66us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906833.059126:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787906833.059145:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787906833.059151:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000326912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906833.059181:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000326912:12345-0@lo:400:kworker.0 Request processed in 31us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906833.059187:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787906833.059276:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787906833.059286:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000327040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906833.059314:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000327040:12345-0@lo:400:kworker.0 Request processed in 31us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906833.059321:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787906833.059340:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000327168 00000100:00100000:1.0:1787906833.059343:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000327168 00000100:00100000:1.0:1787906833.059433:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000327424 00000100:00100000:1.0:1787906833.059437:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000327424 00000100:00100000:1.0:1787906833.059457:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787906833.059463:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000327168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906833.059495:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000327168:12345-0@lo:400:kworker.0 Request processed in 32us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906833.059501:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787906833.059512:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787906833.059517:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000327424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906833.059542:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000327424:12345-0@lo:400:kworker.0 Request processed in 25us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906833.059553:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787906833.059585:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787906833.059589:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787906833.059591:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906833.059629:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000327040:0@lo:400:kworker.0 00000100:00100000:1.0:1787906833.059639:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000326912:0@lo:400:kworker.0 00010000:00080000:1.0:1787906833.059664:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa40203e300 x1874756000327424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906833.059673:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000327424:0@lo:400:kworker.0 00010000:00080000:1.0:1787906833.059704:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa40203ca80 x1874756000327168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906833.059714:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000327168:0@lo:400:kworker.0 00000100:00100000:1.0:1787906833.059723:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000327296:0@lo:400:kworker.0 00000100:00100000:3.0:1787906833.062316:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000326784 00000100:00100000:3.0:1787906833.062336:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000326784 00000100:00100000:3.0:1787906833.062544:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787906833.062556:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000326784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906833.062670:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000326784:12345-0@lo:400:kworker.0 Request processed in 116us (4137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906833.062677:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787906833.064000:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000326784:0@lo:400:kworker.0 00000100:00100000:1.0:1787906833.567999:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906833.568025:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000327552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787906833.568122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906833.568213:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000327552 00000100:00100000:1.0:1787906833.568225:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000327552 00000100:00100000:1.0:1787906833.568282:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787906833.568293:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000327552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787906833.568353:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906833.568411:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000327552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906833.568419:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787906833.568483:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa40203d500 x1874756000327552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906833.568504:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000327552:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906834.082092:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906835.105648:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787906835.892158:0:9442:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.85 00010000:00010000:3.0:1787906836.127939:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906836.130230:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000327680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787906836.130313:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906836.130529:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000327680 00000100:00100000:3.0:1787906836.130540:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000327680 00000100:00100000:3.0:1787906836.130631:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787906836.130643:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000327680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787906836.130685:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906836.130735:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000327680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906836.130750:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787906836.130855:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787906836.130892:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f76d80 x1874756000327680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906836.130914:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000327680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906836.494716:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906836.494766:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906836.494852:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971981952 00000100:00100000:0.0:1787906836.494873:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971981952 00000100:00100000:0.0:1787906836.494949:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 204 00000100:00100000:0.0:1787906836.494959:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+10:2344:x1874755971981952:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906836.495206:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+10:2344:x1874755971981952:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 246us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906836.495214:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 204 00000100:00100000:1.0:1787906836.495302:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971982080 00000100:00100000:1.0:1787906836.495307:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971982080 00000100:00100000:1.0:1787906836.495366:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:1.0:1787906836.495373:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2344:x1874755971982080:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906836.495408:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2344:x1874755971982080:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 36us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906836.495415:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00080000:0.0:1787906836.496639:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787906837.152561:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787906837.773485:0:9490:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Aug 28 04:47:15 EDT 2026 00010000:00010000:3.0:1787906838.176393:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906838.176984:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000328064:0@lo:400:kworker.0 00000100:00100000:0.0:1787906838.177053:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906838.177132:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787906838.177140:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000327936:0@lo:400:kworker.0 00000100:00100000:0.0:1787906838.177165:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906838.177183:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000328448:0@lo:400:kworker.0 00000100:00100000:0.0:1787906838.177208:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906838.177407:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000328192:0@lo:400:kworker.0 00000100:00100000:1.0:1787906838.177438:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906838.177470:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787906838.177476:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000327808:0@lo:400:kworker.0 00000100:00100000:1.0:1787906838.177503:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906838.177530:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000328320:0@lo:400:kworker.0 00000100:00100000:1.0:1787906838.177561:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906838.177605:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000328064 00000100:00100000:1.0:1787906838.177612:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000328064 00000100:00100000:1.0:1787906838.177660:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000327936 00000100:00100000:1.0:1787906838.177663:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000327936 00000100:00100000:1.0:1787906838.177675:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000328320 00000100:00100000:1.0:1787906838.177677:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000328320 00000100:00100000:1.0:1787906838.177693:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787906838.177701:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000328064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906838.177761:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000328064:12345-0@lo:400:kworker.0 Request processed in 61us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906838.177768:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787906838.177782:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787906838.177788:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000327936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906838.177836:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000327936:12345-0@lo:400:kworker.0 Request processed in 48us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906838.177843:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787906838.177854:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787906838.177860:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000328320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906838.177892:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000328320:12345-0@lo:400:kworker.0 Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906838.177897:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787906838.177918:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000328448 00000100:00100000:1.0:1787906838.177922:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000328448 00000100:00100000:1.0:1787906838.177945:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000328192 00000100:00100000:1.0:1787906838.177948:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000328192 00000100:00100000:1.0:1787906838.177966:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787906838.177973:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000328448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906838.178007:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000328448:12345-0@lo:400:kworker.0 Request processed in 35us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906838.178019:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787906838.178030:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787906838.178035:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000328192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906838.178064:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000328192:12345-0@lo:400:kworker.0 Request processed in 29us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906838.178230:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000327808 00000100:00100000:3.0:1787906838.178235:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000327808 00000100:00100000:3.0:1787906838.178266:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787906838.178274:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000327808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906838.178310:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000327808:12345-0@lo:400:kworker.0 Request processed in 37us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906838.178315:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:3.0:1787906838.178365:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787906838.178369:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787906838.178372:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906838.178406:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000327936:0@lo:400:kworker.0 00010000:00080000:3.0:1787906838.178420:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe5c00 x1874756000328448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906838.178431:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000328448:0@lo:400:kworker.0 00000100:00100000:3.0:1787906838.178442:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000328064:0@lo:400:kworker.0 00000100:00100000:3.0:1787906838.178495:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000327808:0@lo:400:kworker.0 00000100:00100000:3.0:1787906838.178505:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000328320:0@lo:400:kworker.0 00010000:00080000:3.0:1787906838.178514:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe4000 x1874756000328192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906838.178522:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000328192:0@lo:400:kworker.0 00000100:00100000:1.0:1787906838.178608:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787906838.688195:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000328576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787906838.688279:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906838.688448:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000328576 00000100:00100000:1.0:1787906838.688457:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000328576 00000100:00100000:1.0:1787906838.688514:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787906838.688525:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000328576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787906838.688571:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906838.688638:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000328576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906838.688645:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787906838.688734:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa40203f800 x1874756000328576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906838.688755:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000328576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906839.200554:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906840.224104:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906841.248731:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906841.252614:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787906841.252643:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000328704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787906841.252737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906841.253269:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000328704 00000100:00100000:3.0:1787906841.253279:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000328704 00000100:00100000:3.0:1787906841.253350:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787906841.253361:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000328704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787906841.253404:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906841.253470:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000328704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906841.253477:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787906841.253529:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f75f80 x1874756000328704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906841.253558:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000328704:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787906841.254011:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787906841.610739:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906841.610787:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906841.610894:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971982208 00000100:00100000:2.0:1787906841.610904:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971982208 00000100:00100000:2.0:1787906841.610966:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 206 00000100:00100000:2.0:1787906841.610978:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:2345:x1874755971982208:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906841.611056:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:2345:x1874755971982208:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906841.611074:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 206 00000100:00100000:1.0:1787906841.616886:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971982336 00000100:00100000:1.0:1787906841.616906:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971982336 00000100:00100000:0.0:1787906841.619687:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:0.0:1787906841.619703:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755971982336:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906841.619840:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755971982336:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 141us (9051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906841.619847:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00080000:3.0:1787906841.620525:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787906842.273836:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906843.297162:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906843.300928:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000328832:0@lo:400:kworker.0 00000100:00100000:2.0:1787906843.301002:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906843.301057:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000329344:0@lo:400:kworker.0 00000100:00100000:2.0:1787906843.301086:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906843.301116:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787906843.301122:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000329216:0@lo:400:kworker.0 00000100:00100000:2.0:1787906843.301147:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906843.301172:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000328960:0@lo:400:kworker.0 00000100:00100000:2.0:1787906843.301192:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906843.301205:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000329472:0@lo:400:kworker.0 00000100:00100000:2.0:1787906843.301220:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906843.301234:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787906843.301238:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000329088:0@lo:400:kworker.0 00000100:00100000:2.0:1787906843.301253:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906843.301277:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000329344 00000100:00100000:2.0:1787906843.301283:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000329344 00000100:00100000:2.0:1787906843.301328:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000328960 00000100:00100000:2.0:1787906843.301331:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000328960 00000100:00100000:2.0:1787906843.301344:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000329088 00000100:00100000:2.0:1787906843.301346:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000329088 00000100:00100000:2.0:1787906843.301362:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787906843.301371:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000329344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906843.301423:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000329344:12345-0@lo:400:kworker.0 Request processed in 53us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906843.301430:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787906843.301474:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787906843.301481:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000328960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906843.301514:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000328960:12345-0@lo:400:kworker.0 Request processed in 34us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906843.301521:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787906843.301533:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787906843.301538:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000329088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906843.301563:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000329088:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906843.301568:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787906843.301586:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000329216 00000100:00100000:2.0:1787906843.301589:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000329216 00000100:00100000:2.0:1787906843.301615:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000329472 00000100:00100000:2.0:1787906843.301617:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000329472 00000100:00100000:2.0:1787906843.301632:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787906843.301638:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000329216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906843.301667:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000329216:12345-0@lo:400:kworker.0 Request processed in 29us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906843.301673:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787906843.301684:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787906843.301690:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000329472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906843.301714:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000329472:12345-0@lo:400:kworker.0 Request processed in 25us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906843.301906:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1787906843.301932:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787906843.301936:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787906843.301939:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906843.302073:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000329088:0@lo:400:kworker.0 00000100:00100000:2.0:1787906843.302083:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000328960:0@lo:400:kworker.0 00010000:00080000:2.0:1787906843.302093:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f76a00 x1874756000329472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906843.302103:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000329472:0@lo:400:kworker.0 00010000:00080000:2.0:1787906843.302130:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f75880 x1874756000329216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906843.302139:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000329216:0@lo:400:kworker.0 00000100:00100000:2.0:1787906843.302147:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000329344:0@lo:400:kworker.0 00000100:00100000:3.0:1787906843.302245:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000328832 00000100:00100000:3.0:1787906843.302249:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000328832 00000100:00100000:3.0:1787906843.302276:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787906843.302282:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000328832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906843.302319:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000328832:12345-0@lo:400:kworker.0 Request processed in 37us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906843.302325:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787906843.302635:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000328832:0@lo:400:kworker.0 00000100:00100000:3.0:1787906843.810571:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787906843.810598:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000329600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787906843.810671:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906843.810758:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000329600 00000100:00100000:3.0:1787906843.810765:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000329600 00000100:00100000:3.0:1787906843.810842:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787906843.810853:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000329600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787906843.810889:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906843.810938:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000329600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906843.810945:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787906843.810987:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f77100 x1874756000329600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906843.811008:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000329600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787906844.325873:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906845.344449:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906846.370606:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787906846.370635:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000329728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787906846.370744:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906846.371750:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000329728 00000100:00100000:3.0:1787906846.371764:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000329728 00000100:00100000:3.0:1787906846.371932:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787906846.371944:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000329728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787906846.374321:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906846.374484:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000329728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2538us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906846.374498:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787906846.374609:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1787906846.374652:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f77100 x1874756000329728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906846.374692:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000329728:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787906846.375178:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906846.732001:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906846.732097:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906846.734586:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971982464 00000100:00100000:3.0:1787906846.734611:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971982464 00000100:00100000:3.0:1787906846.734919:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 208 00000100:00100000:3.0:1787906846.734946:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:2345:x1874755971982464:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906846.735046:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:2345:x1874755971982464:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 103us (3055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906846.735054:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 208 00000100:00100000:1.0:1787906846.737321:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971982592 00000100:00100000:1.0:1787906846.737332:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971982592 00000100:00100000:1.0:1787906846.737410:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:1.0:1787906846.737421:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755971982592:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906846.737497:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755971982592:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 78us (5398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906846.737514:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00080000:1.0:1787906846.737543:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787906847.392356:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906848.417225:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000329856:0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.417327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906848.417393:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000330368:0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.417423:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906848.417453:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787906848.417459:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000330240:0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.417483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906848.417517:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000329984:0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.417540:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906848.417563:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000330496:0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.417584:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906848.417605:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787906848.417610:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000330112:0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.417657:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906848.422886:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000329856 00000100:00100000:3.0:1787906848.422908:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000329856 00000100:00100000:3.0:1787906848.422979:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787906848.422992:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000329856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.423117:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000329856:12345-0@lo:400:kworker.0 Request processed in 128us (5789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906848.423125:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787906848.423190:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000330368 00000100:00100000:3.0:1787906848.423196:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000330368 00000100:00100000:3.0:1787906848.423232:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000329984 00000100:00100000:3.0:1787906848.423235:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000329984 00000100:00100000:3.0:1787906848.423249:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000330112 00000100:00100000:3.0:1787906848.423252:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000330112 00000100:00100000:3.0:1787906848.423273:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787906848.423279:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000330368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.423321:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000330368:12345-0@lo:400:kworker.0 Request processed in 42us (5898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906848.423327:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787906848.423340:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787906848.423359:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000329984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.423399:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000329984:12345-0@lo:400:kworker.0 Request processed in 54us (5858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906848.423406:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787906848.423417:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787906848.423424:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000330112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.423454:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000330112:12345-0@lo:400:kworker.0 Request processed in 31us (5797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906848.423460:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787906848.423486:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000330240 00000100:00100000:3.0:1787906848.423492:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000330240 00000100:00100000:3.0:1787906848.423520:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000330496 00000100:00100000:3.0:1787906848.423524:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000330496 00000100:00100000:3.0:1787906848.423546:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787906848.423553:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000330240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.423592:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000330240:12345-0@lo:400:kworker.0 Request processed in 40us (6108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906848.423607:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787906848.423621:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787906848.423628:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000330496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.423658:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000330496:12345-0@lo:400:kworker.0 Request processed in 32us (6073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906848.423664:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787906848.423870:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000330112:0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.423882:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000329984:0@lo:400:kworker.0 00010000:00080000:3.0:1787906848.423895:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f75880 x1874756000330496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906848.423906:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000330496:0@lo:400:kworker.0 00010000:00080000:3.0:1787906848.423947:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534f74380 x1874756000330240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906848.423957:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000330240:0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.423968:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000329856:0@lo:400:kworker.0 00000100:00100000:3.0:1787906848.423978:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000330368:0@lo:400:kworker.0 00010000:00010000:3.0:1787906848.424131:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787906848.424790:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787906848.424796:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787906848.424798:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906848.933770:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906848.933800:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000330624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787906848.933909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906848.934162:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000330624 00000100:00100000:3.0:1787906848.934173:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000330624 00000100:00100000:3.0:1787906848.934245:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787906848.934257:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000330624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787906848.934312:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906848.934397:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000330624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906848.934405:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787906848.935660:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534a08000 x1874756000330624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906848.935685:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000330624:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906849.440283:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906850.467640:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906851.488120:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906851.488627:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787906851.488650:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000330752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787906851.488716:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906851.488781:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000330752 00000100:00100000:1.0:1787906851.488788:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000330752 00000100:00100000:1.0:1787906851.489104:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787906851.489117:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000330752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787906851.489154:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906851.489210:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000330752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906851.489219:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787906851.489298:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa40203c380 x1874756000330752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906851.489324:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000330752:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787906851.489405:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787906851.854771:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906851.854916:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906851.855010:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971982848 00000100:00100000:1.0:1787906851.855020:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971982848 00000100:00100000:1.0:1787906851.855087:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:1.0:1787906851.855098:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755971982848:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906851.855196:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755971982848:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 99us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906851.855204:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:3.0:1787906851.855909:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971982720 00000100:00100000:3.0:1787906851.855917:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971982720 00000100:00100000:3.0:1787906851.855960:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 210 00000100:00100000:3.0:1787906851.855968:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:2344:x1874755971982720:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906851.856008:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:2344:x1874755971982720:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 40us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906851.856014:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 210 00000100:00080000:2.0:1787906851.856208:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787906852.513103:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906853.536072:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906853.536112:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000330880:0@lo:400:kworker.0 00000100:00100000:3.0:1787906853.536216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906853.536290:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000331392:0@lo:400:kworker.0 00000100:00100000:3.0:1787906853.536318:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906853.536318:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000331264:0@lo:400:kworker.0 00000100:00100000:3.0:1787906853.536357:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000330880 00000100:00100000:3.0:1787906853.536365:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000330880 00000100:00100000:1.0:1787906853.536398:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906853.536412:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787906853.536423:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000330880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906853.536448:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000331008:0@lo:400:kworker.0 00000100:00100000:3.0:1787906853.536476:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000330880:12345-0@lo:400:kworker.0 Request processed in 53us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906853.536483:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906853.536503:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000331520:0@lo:400:kworker.0 00000100:00100000:1.0:1787906853.536524:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906853.536542:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906853.536548:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000331136:0@lo:400:kworker.0 00000100:00100000:1.0:1787906853.536569:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906853.536598:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000331264 00000100:00100000:1.0:1787906853.536602:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000331264 00000100:00100000:1.0:1787906853.536640:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000331520 00000100:00100000:1.0:1787906853.536643:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000331520 00000100:00100000:1.0:1787906853.536665:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787906853.536672:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000331264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906853.536707:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787906853.536749:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000331392 00000100:00100000:3.0:1787906853.536753:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000331392 00000100:00100000:3.0:1787906853.537066:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000331008 00000100:00100000:3.0:1787906853.537070:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000331008 00000100:00100000:3.0:1787906853.537085:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000331136 00000100:00100000:3.0:1787906853.537089:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000331136 00000100:00100000:3.0:1787906853.537105:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787906853.537113:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000331392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906853.537152:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000331392:12345-0@lo:400:kworker.0 Request processed in 40us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906853.537159:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787906853.537190:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000331264:12345-0@lo:400:kworker.0 Request processed in 516us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906853.537199:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787906853.537219:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787906853.537234:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000331520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906853.537284:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000331520:12345-0@lo:400:kworker.0 Request processed in 51us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906853.537290:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787906853.537307:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787906853.537314:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787906853.537320:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000331008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906853.537327:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000331136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906853.537365:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000331008:12345-0@lo:400:kworker.0 Request processed in 50us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906853.537372:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787906853.537376:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000331136:12345-0@lo:400:kworker.0 Request processed in 51us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906853.537384:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1787906853.537417:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906853.537418:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000331392:0@lo:400:kworker.0 00000100:00080000:1.0:1787906853.537422:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787906853.537427:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787906853.537432:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000330880:0@lo:400:kworker.0 00000100:00100000:1.0:1787906853.537460:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000331136:0@lo:400:kworker.0 00000100:00100000:1.0:1787906853.537474:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000331008:0@lo:400:kworker.0 00010000:00080000:1.0:1787906853.537486:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa40203c380 x1874756000331520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906853.537495:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000331520:0@lo:400:kworker.0 00010000:00080000:0.0:1787906853.543002:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa52efe6a00 x1874756000331264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906853.543023:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000331264:0@lo:400:kworker.0 00000100:00100000:1.0:1787906854.048131:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000331648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787906854.048206:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906854.048407:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000331648 00000100:00100000:3.0:1787906854.048417:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000331648 00000100:00100000:3.0:1787906854.048469:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787906854.048478:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000331648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787906854.048523:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906854.048743:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000331648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 265us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906854.048752:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787906854.056067:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534a08e00 x1874756000331648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906854.056105:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000331648:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906854.559982:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906855.589296:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906856.609373:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000331776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787906856.609459:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906856.609559:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000331776 00000100:00100000:1.0:1787906856.609570:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000331776 00000100:00100000:1.0:1787906856.609640:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787906856.609652:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000331776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787906856.609721:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906856.609774:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000331776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906856.609781:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787906856.609805:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787906856.609866:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa52f3bb800 x1874756000331776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906856.609887:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000331776:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787906856.610601:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787906856.689478:0:10121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 04:47:34 (1787906854) === 00000100:00100000:2.0:1787906856.983251:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906856.983313:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906856.983486:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971982976 00000100:00100000:1.0:1787906856.983500:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971982976 00000100:00100000:1.0:1787906856.983576:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 212 00000100:00100000:1.0:1787906856.983588:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:2345:x1874755971982976:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906856.983693:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+10:2345:x1874755971982976:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 107us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906856.983702:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 212 00000100:00100000:3.0:1787906856.985423:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971983104 00000100:00100000:3.0:1787906856.985436:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971983104 00000100:00100000:3.0:1787906856.985574:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:3.0:1787906856.985586:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755971983104:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906856.985668:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755971983104:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 85us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906856.985675:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00080000:1.0:1787906856.994266:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906857.419319:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906857.419421:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971983232 00000100:00100000:3.0:1787906857.419435:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971983232 00000100:00100000:3.0:1787906857.419506:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 213 00000100:00100000:3.0:1787906857.419518:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+10:8141:x1874755971983232:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787906857.419536:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906857.419554:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad306 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef56f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906857.419583:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef56f expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906857.419594:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef56f expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906857.419603:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511995600, rc 0) 00000100:00100000:3.0:1787906857.419690:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+11:8141:x1874755971983232:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 174us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906857.419697:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 213 00000100:00100000:0.0:1787906857.425240:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906857.425554:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971983360 00000100:00100000:2.0:1787906857.425565:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971983360 00000100:00100000:2.0:1787906857.425631:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 214 00000100:00100000:2.0:1787906857.425642:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+11:8141:x1874755971983360:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787906857.426118:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+11:8141:x1874755971983360:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 477us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906857.426136:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 214 00000100:00100000:0.0:1787906857.428562:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906857.430154:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971983488 00000100:00100000:1.0:1787906857.430242:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971983488 00000100:00100000:1.0:1787906857.430410:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00100000:1.0:1787906857.430423:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+11:8141:x1874755971983488:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787906857.430687:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+11:8141:x1874755971983488:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 266us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906857.430704:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00100000:2.0:1787906857.436127:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906857.436302:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971983616 00000100:00100000:3.0:1787906857.436312:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971983616 00000100:00100000:3.0:1787906857.436417:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 216 00000100:00100000:3.0:1787906857.436445:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+11:8145:x1874755971983616:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787906857.436995:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+11:8145:x1874755971983616:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 551us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906857.437003:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 216 00000100:00100000:0.0:1787906857.456947:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906857.457422:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971983744 00000100:00100000:1.0:1787906857.457434:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971983744 00000100:00100000:1.0:1787906857.457518:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 217 00000100:00100000:1.0:1787906857.457532:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+11:8145:x1874755971983744:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787906857.458244:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+11:8145:x1874755971983744:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 710us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906857.458255:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 217 00000100:00100000:1.0:1787906857.473051:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906857.473244:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971983872 00000100:00100000:3.0:1787906857.473257:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971983872 00000100:00100000:3.0:1787906857.473325:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 218 00000100:00100000:3.0:1787906857.473338:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+11:8141:x1874755971983872:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787906857.473359:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906857.473382:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511994e00/0x72bb6cf063cad30d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef599 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906857.473504:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511994e00/0x72bb6cf063cad30d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef599 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906857.473517:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511994e00/0x72bb6cf063cad30d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef599 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906857.473527:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511994e00, rc 0) 00000100:00100000:3.0:1787906857.473601:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+12:8141:x1874755971983872:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 265us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906857.473616:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 218 00000100:00100000:2.0:1787906857.491130:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906857.491297:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971984000 00000100:00100000:0.0:1787906857.491308:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971984000 00000100:00100000:0.0:1787906857.491411:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 219 00000100:00100000:0.0:1787906857.491423:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+12:8141:x1874755971984000:12345-192.168.204.20@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787906857.491455:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787906857.491480:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787906857.491485:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787906857.491488:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787906857.491491:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787906857.497318:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+12:8141:x1874755971984000:12345-192.168.204.20@tcp:256:mount.lustre.0 Request processed in 5877us (6183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906857.497335:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 219 00000100:00100000:1.0:1787906857.508051:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906857.508180:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971984128 00000100:00100000:3.0:1787906857.508193:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971984128 00000100:00100000:3.0:1787906857.508283:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 220 00000100:00100000:3.0:1787906857.508294:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+12:8141:x1874755971984128:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787906857.508314:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906857.508336:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad314 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef5a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906857.508368:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5a0 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906857.508379:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5a0 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906857.508389:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511995400, rc 0) 00000100:00100000:3.0:1787906857.508645:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:8141:x1874755971984128:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 351us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906857.508653:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 220 00000100:00100000:2.0:1787906857.521103:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906857.521216:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971984256 00000100:00100000:3.0:1787906857.521230:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971984256 00000100:00100000:3.0:1787906857.521329:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 221 00000100:00100000:3.0:1787906857.521341:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:8141:x1874755971984256:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787906857.521677:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:8141:x1874755971984256:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 337us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906857.521686:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 221 00000100:00100000:0.0:1787906857.524797:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906857.525130:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971984384 00000100:00100000:3.0:1787906857.525143:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971984384 00000100:00100000:3.0:1787906857.525257:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 222 00000100:00100000:3.0:1787906857.525268:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:8141:x1874755971984384:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787906857.525569:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:8141:x1874755971984384:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 302us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906857.525579:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 222 00000100:00100000:1.0:1787906857.531551:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906857.531667:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971984512 00000100:00100000:3.0:1787906857.531678:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971984512 00000100:00100000:2.0:1787906857.532393:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 223 00000100:00100000:2.0:1787906857.532407:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:8149:x1874755971984512:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787906857.532921:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:8149:x1874755971984512:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 515us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906857.532932:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 223 00000100:00100000:0.0:1787906857.545118:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906857.545364:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971984640 00000100:00100000:3.0:1787906857.545376:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971984640 00000100:00100000:3.0:1787906857.545850:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 224 00000100:00100000:3.0:1787906857.545862:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:8149:x1874755971984640:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787906857.546181:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:8149:x1874755971984640:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 311us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906857.546189:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 224 00000100:00100000:0.0:1787906857.555415:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906857.555463:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906857.555557:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971984768 00000100:00100000:1.0:1787906857.555572:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971984768 00000100:00100000:1.0:1787906857.555633:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971984896 00000100:00100000:1.0:1787906857.555636:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971984896 00000100:00100000:1.0:1787906857.555674:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:1.0:1787906857.555688:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2344:x1874755971984896:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906857.555790:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2344:x1874755971984896:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 105us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906857.555798:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:1.0:1787906857.555850:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:1.0:1787906857.555855:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2342:x1874755971984768:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787906857.555886:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0090c414-ebc1-4e0b-a520-0378a8ae450c@192.168.204.20@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:1.0:1787906857.555935:0:5831:0:(genops.c:1385:class_connect()) connect: client 0090c414-ebc1-4e0b-a520-0378a8ae450c, cookie 0x72bb6cf063cad31b 00000004:00100000:1.0:1787906857.555979:0:5831:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787906857.556331:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8aa534c9e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787906857.556373:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:2342:x1874755971984768:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 516us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906857.556402:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:1.0:1787906857.575546:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906857.575851:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971985024 00000100:00100000:2.0:1787906857.575864:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971985024 00000100:00100000:2.0:1787906857.575959:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1787906857.575976:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:0:x1874755971985024:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787906857.576035:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787906857.576157:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:0:x1874755971985024:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 186us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906857.576166:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00080000:1.0:1787906857.576423:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906857.584913:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906857.585073:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971985152 00000100:00100000:2.0:1787906857.585201:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971985152 00000100:00100000:2.0:1787906857.585282:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:2.0:1787906857.585294:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:8141:x1874755971985152:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787906857.585346:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787906857.585459:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:8141:x1874755971985152:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 167us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906857.585839:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:0.0:1787906857.594631:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906857.594915:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971985280 00000100:00100000:3.0:1787906857.594926:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971985280 00000100:00100000:3.0:1787906857.595001:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1787906857.595013:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:8141:x1874755971985280:12345-192.168.204.20@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787906857.595127:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:8141:x1874755971985280:12345-192.168.204.20@tcp:40:mount.lustre.0 Request processed in 115us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906857.595135:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:0.0:1787906857.604505:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906857.604569:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906857.604623:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906857.604851:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971985408 00000100:00100000:1.0:1787906857.604861:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971985408 00000100:00100000:1.0:1787906857.604906:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971985536 00000100:00100000:1.0:1787906857.604910:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971985536 00000100:00100000:1.0:1787906857.604934:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1787906857.604942:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2342:x1874755971985408:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787906857.604975:0:6674:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0090c414-ebc1-4e0b-a520-0378a8ae450c@192.168.204.20@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:1.0:1787906857.605006:0:6674:0:(genops.c:1385:class_connect()) connect: client 0090c414-ebc1-4e0b-a520-0378a8ae450c, cookie 0x72bb6cf063cad322 00002000:00100000:1.0:1787906857.605019:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0090c414-ebc1-4e0b-a520-0378a8ae450c/ffff8aa534c9f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787906857.605030:0:6674:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787906857.605302:0:6674:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787906857.605331:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8aa534c98800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787906857.605394:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:2342:x1874755971985408:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 451us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906857.605402:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1787906857.605422:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:1.0:1787906857.605427:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2342:x1874755971985536:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787906857.605443:0:6674:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0090c414-ebc1-4e0b-a520-0378a8ae450c@192.168.204.20@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:1.0:1787906857.605460:0:6674:0:(genops.c:1385:class_connect()) connect: client 0090c414-ebc1-4e0b-a520-0378a8ae450c, cookie 0x72bb6cf063cad329 00002000:00100000:1.0:1787906857.605466:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0090c414-ebc1-4e0b-a520-0378a8ae450c/ffff8aa534c99800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787906857.605486:0:6674:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787906857.605658:0:6674:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787906857.605674:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8aa534c9d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787906857.605712:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:2342:x1874755971985536:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 283us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906857.605720:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:2.0:1787906857.607857:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971985664 00000100:00100000:2.0:1787906857.607875:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971985664 00000100:00100000:2.0:1787906857.607967:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:2.0:1787906857.607981:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:8141:x1874755971985664:12345-192.168.204.20@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787906857.608337:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787906857.608522:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:8141:x1874755971985664:12345-192.168.204.20@tcp:33:mount.lustre.0 Request processed in 543us (3897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906857.608531:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00010000:00010000:3.0:1787906857.632145:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787906857.716092:0:6699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0090c414-ebc1-4e0b-a520-0378a8ae450c 00000100:00100000:1.0:1787906858.656130:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000332288:0@lo:400:kworker.0 00000100:00100000:1.0:1787906858.656233:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906858.656313:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787906858.656322:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000331904:0@lo:400:kworker.0 00000100:00100000:1.0:1787906858.656353:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906858.656377:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000332416:0@lo:400:kworker.0 00000100:00100000:1.0:1787906858.656403:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906858.656434:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000332032:0@lo:400:kworker.0 00000100:00100000:1.0:1787906858.656457:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906858.656473:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000332544:0@lo:400:kworker.0 00000100:00100000:1.0:1787906858.656494:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906858.656511:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906858.656518:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000332160:0@lo:400:kworker.0 00000100:00100000:1.0:1787906858.656539:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906858.656583:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000332288 00000100:00100000:1.0:1787906858.656595:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000332288 00000100:00100000:1.0:1787906858.656663:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000332544 00000100:00100000:1.0:1787906858.656667:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000332544 00000100:00100000:1.0:1787906858.656693:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787906858.656703:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000332288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906858.656774:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000332288:12345-0@lo:400:kworker.0 Request processed in 72us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906858.656797:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787906858.656851:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787906858.656858:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000332544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906858.656893:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000332544:12345-0@lo:400:kworker.0 Request processed in 36us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906858.656900:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787906858.657090:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000332416 00000100:00100000:1.0:1787906858.657095:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000332416 00000100:00100000:1.0:1787906858.657116:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000332032 00000100:00100000:1.0:1787906858.657118:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000332032 00000100:00100000:1.0:1787906858.657127:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000332160 00000100:00100000:1.0:1787906858.657130:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000332160 00000100:00100000:1.0:1787906858.657143:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787906858.657162:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000332416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906858.657194:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000332416:12345-0@lo:400:kworker.0 Request processed in 46us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906858.657201:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787906858.657213:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787906858.657219:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000332032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906858.657244:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000332032:12345-0@lo:400:kworker.0 Request processed in 26us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906858.657249:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787906858.657260:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787906858.657265:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000332160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906858.657298:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000332160:12345-0@lo:400:kworker.0 Request processed in 33us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906858.657304:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787906858.657330:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787906858.657335:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787906858.657337:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787906858.657372:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000332160:0@lo:400:kworker.0 00000100:00100000:1.0:1787906858.657383:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000332032:0@lo:400:kworker.0 00010000:00080000:1.0:1787906858.657395:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa52f3b8700 x1874756000332544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906858.657404:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000332544:0@lo:400:kworker.0 00000100:00100000:1.0:1787906858.657434:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000332416:0@lo:400:kworker.0 00010000:00080000:1.0:1787906858.657445:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa52f3bad80 x1874756000332288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906858.657454:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000332288:0@lo:400:kworker.0 00000100:00100000:3.0:1787906858.658614:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000331904 00000100:00100000:3.0:1787906858.658630:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000331904 00000100:00100000:3.0:1787906858.658688:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787906858.658698:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000331904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906858.658765:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000331904:12345-0@lo:400:kworker.0 Request processed in 68us (2410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906858.658793:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00010000:00010000:3.0:1787906858.658890:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906858.658921:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000331904:0@lo:400:kworker.0 00000100:00100000:1.0:1787906859.172733:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906859.172757:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000332672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787906859.173477:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906859.173603:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000332672 00000100:00100000:2.0:1787906859.173613:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000332672 00000100:00100000:2.0:1787906859.173684:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787906859.173695:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000332672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787906859.173732:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906859.173802:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000332672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906859.173830:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787906859.174045:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa52f3bad80 x1874756000332672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906859.174069:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000332672:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787906859.680250:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906860.704766:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787906860.796871:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0090c414-ebc1-4e0b-a520-0378a8ae450c 00000001:00100000:3.0:1787906861.273657:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0090c414-ebc1-4e0b-a520-0378a8ae450c 00010000:00010000:3.0:1787906861.728999:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906861.744741:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5170a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000332800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906861.744843:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906861.745046:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000332800 00000100:00100000:0.0:1787906861.745056:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000332800 00000100:00100000:0.0:1787906861.745143:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787906861.745154:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000332800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787906861.745197:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906861.745251:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000332800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906861.745259:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1787906861.745329:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787906861.745362:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa5170a4700 x1874756000332800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906861.745384:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5170a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000332800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787906862.752041:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906863.115610:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906863.115676:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906863.115955:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971986176 00000100:00100000:2.0:1787906863.115974:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971986176 00000100:00100000:2.0:1787906863.116105:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:2.0:1787906863.116119:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2343:x1874755971986176:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906863.116220:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971985920 00000100:00100000:1.0:1787906863.116225:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971985920 00000100:00100000:1.0:1787906863.116265:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:1.0:1787906863.116273:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755971985920:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:3.0:1787906863.116333:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787906863.116338:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787906863.119187:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2343:x1874755971986176:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 3060us (3497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906863.119203:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:1.0:1787906863.121541:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755971985920:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 5253us (5944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906863.121578:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:0.0:1787906863.125896:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906863.126075:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906863.126117:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906863.126233:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971986304 00000100:00100000:2.0:1787906863.126248:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971986304 00000100:00100000:2.0:1787906863.126334:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:2.0:1787906863.126346:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2343:x1874755971986304:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906863.126438:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2343:x1874755971986304:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 94us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906863.126445:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:1.0:1787906863.126918:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971986048 00000100:00100000:1.0:1787906863.126927:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971986048 00000100:00100000:1.0:1787906863.126975:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:1.0:1787906863.126984:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2343:x1874755971986048:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906863.127031:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2343:x1874755971986048:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 48us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906863.127038:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00080000:0.0:1787906863.128089:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787906863.128098:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787906863.134270:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971985792 00000100:00100000:3.0:1787906863.134290:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971985792 00000100:00100000:3.0:1787906863.134379:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 226 00000100:00100000:3.0:1787906863.134391:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:2343:x1874755971985792:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906863.134489:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:2343:x1874755971985792:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 100us (8605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906863.134497:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 226 00000100:00100000:1.0:1787906863.778014:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000333312:0@lo:400:kworker.0 00000100:00100000:1.0:1787906863.778121:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906863.778193:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787906863.778200:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000332928:0@lo:400:kworker.0 00000100:00100000:1.0:1787906863.778232:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906863.778257:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000333440:0@lo:400:kworker.0 00000100:00100000:1.0:1787906863.778286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906863.778315:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000333056:0@lo:400:kworker.0 00000100:00100000:1.0:1787906863.778342:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906863.778361:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000333568:0@lo:400:kworker.0 00000100:00100000:1.0:1787906863.778382:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906863.778401:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906863.778407:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000333184:0@lo:400:kworker.0 00000100:00100000:1.0:1787906863.778430:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906863.778467:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000333312 00000100:00100000:1.0:1787906863.778476:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000333312 00000100:00100000:1.0:1787906863.778575:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000333568 00000100:00100000:1.0:1787906863.778579:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000333568 00000100:00100000:1.0:1787906863.778607:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787906863.778618:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000333312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906863.778684:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000333312:12345-0@lo:400:kworker.0 Request processed in 68us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906863.778693:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1787906863.780028:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787906863.781529:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906863.781657:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000333440 00000100:00100000:0.0:1787906863.781669:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000333440 00000100:00100000:0.0:1787906863.781762:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000333056 00000100:00100000:0.0:1787906863.781766:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000333056 00000100:00100000:0.0:1787906863.781781:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000333184 00000100:00100000:0.0:1787906863.781783:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000333184 00000100:00100000:0.0:1787906863.781805:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787906863.781835:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000333440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906863.781944:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000333440:12345-0@lo:400:kworker.0 Request processed in 131us (3657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906863.781953:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787906863.781973:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787906863.781980:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000333056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906863.782016:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787906863.782030:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000333056:12345-0@lo:400:kworker.0 Request processed in 50us (3686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906863.782032:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000333568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906863.782044:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787906863.782076:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787906863.782084:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000333184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906863.782097:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000333568:12345-0@lo:400:kworker.0 Request processed in 71us (3712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906863.782105:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787906863.782123:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000333184:12345-0@lo:400:kworker.0 Request processed in 40us (3692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906863.782130:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787906863.782167:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000332928 00000100:00100000:0.0:1787906863.782171:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000332928 00000100:00100000:1.0:1787906863.782190:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000333440:0@lo:400:kworker.0 00010000:00080000:1.0:1787906863.782211:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa52f3b8e00 x1874756000333312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906863.782214:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787906863.782225:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000332928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906863.782229:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000333312:0@lo:400:kworker.0 00000100:00100000:0.0:1787906863.782275:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000332928:12345-0@lo:400:kworker.0 Request processed in 52us (4042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906863.782282:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:0.0:1787906863.782313:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906863.782343:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000333184:0@lo:400:kworker.0 00000100:00100000:0.0:1787906863.782357:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000333056:0@lo:400:kworker.0 00010000:00080000:0.0:1787906863.782369:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa52f3bb100 x1874756000333568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906863.782380:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000333568:0@lo:400:kworker.0 00000100:00100000:1.0:1787906863.782415:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000332928:0@lo:400:kworker.0 00010000:00010000:2.0:1787906863.782518:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906864.290760:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787906864.290783:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000333696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787906864.290880:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906864.290995:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000333696 00000100:00100000:1.0:1787906864.291005:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000333696 00000100:00100000:1.0:1787906864.291066:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787906864.291076:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000333696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787906864.291112:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906864.291158:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000333696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906864.291165:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787906864.291500:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa541c1ea00 x1874756000333696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906864.291521:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000333696:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787906864.415028:0:10316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787906864.800120:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906865.830433:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906866.848715:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787906866.848741:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000333824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787906866.848852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906866.848893:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000333824 00010000:00010000:0.0:1787906866.848899:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906866.848903:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000333824 00000100:00080000:0.0:1787906866.848929:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787906866.848962:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787906866.848973:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000333824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787906866.849020:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906866.850333:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000333824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1354us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906866.850349:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787906866.851209:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa541c1ed80 x1874756000333824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906866.851246:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000333824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787906867.872039:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906868.238712:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906868.238744:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906868.238766:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906868.238781:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906868.238800:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906868.238835:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971986560 00000100:00100000:2.0:1787906868.238845:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971986560 00000100:00100000:2.0:1787906868.238895:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971986688 00000100:00100000:2.0:1787906868.238897:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971986688 00000100:00100000:2.0:1787906868.238913:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:2.0:1787906868.238922:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755971986560:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906868.239006:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755971986560:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906868.239014:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:2.0:1787906868.239030:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:2.0:1787906868.239036:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971986688:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906868.239055:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971986688:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 20us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906868.239061:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:2.0:1787906868.239076:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971986432 00000100:00100000:2.0:1787906868.239079:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971986432 00000100:00100000:2.0:1787906868.239113:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 228 00000100:00100000:2.0:1787906868.239119:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755971986432:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906868.239139:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755971986432:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 21us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906868.239145:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 228 00000100:00080000:2.0:1787906868.239168:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906868.239665:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971986816 00000100:00100000:1.0:1787906868.239670:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971986816 00000100:00100000:1.0:1787906868.239719:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971986944 00000100:00100000:1.0:1787906868.239722:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971986944 00000100:00100000:1.0:1787906868.239745:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:1.0:1787906868.239753:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971986816:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906868.239788:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971986816:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 36us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906868.239797:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:1.0:1787906868.239834:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:1.0:1787906868.239841:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971986944:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906868.239868:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971986944:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906868.239873:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00080000:2.0:1787906868.240316:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787906868.240321:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787906868.897582:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906868.899924:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000334080:0@lo:400:kworker.0 00000100:00100000:2.0:1787906868.900031:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906868.900091:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000334592:0@lo:400:kworker.0 00000100:00100000:2.0:1787906868.900121:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906868.900159:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787906868.900165:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000334208:0@lo:400:kworker.0 00000100:00100000:2.0:1787906868.900190:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906868.900238:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000334080 00000100:00100000:2.0:1787906868.900245:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000334080 00000100:00100000:2.0:1787906868.900306:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000334208 00000100:00100000:2.0:1787906868.900309:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000334208 00000100:00100000:2.0:1787906868.900339:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787906868.900348:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000334080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906868.900399:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000334080:12345-0@lo:400:kworker.0 Request processed in 53us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906868.900406:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787906868.900423:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787906868.900430:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000334208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906868.900465:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000334208:12345-0@lo:400:kworker.0 Request processed in 37us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906868.900472:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1787906868.900499:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906868.900696:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000334208:0@lo:400:kworker.0 00000100:00100000:2.0:1787906868.900709:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000334080:0@lo:400:kworker.0 00000100:00100000:1.0:1787906868.900840:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000333952:0@lo:400:kworker.0 00000100:00100000:1.0:1787906868.900882:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906868.900914:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000334464:0@lo:400:kworker.0 00000100:00100000:1.0:1787906868.900936:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906868.900984:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787906868.900991:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000334336:0@lo:400:kworker.0 00000100:00100000:1.0:1787906868.901017:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906868.901047:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000334592 00000100:00100000:1.0:1787906868.901052:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000334592 00000100:00100000:1.0:1787906868.901093:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000334336 00000100:00100000:1.0:1787906868.901099:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000334336 00000100:00100000:1.0:1787906868.901127:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787906868.901135:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000334592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906868.901181:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000334592:12345-0@lo:400:kworker.0 Request processed in 46us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906868.901188:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787906868.901202:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787906868.901208:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000334336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906868.901243:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000334336:12345-0@lo:400:kworker.0 Request processed in 35us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906868.901249:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787906868.901288:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787906868.901291:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787906868.901311:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53b048e00 x1874756000334336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906868.901323:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000334336:0@lo:400:kworker.0 00000100:00100000:1.0:1787906868.901344:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000334464 00000100:00100000:1.0:1787906868.901347:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000334464 00000100:00100000:1.0:1787906868.901373:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787906868.901380:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000334464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906868.901415:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000334464:12345-0@lo:400:kworker.0 Request processed in 36us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906868.901429:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1787906868.901444:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906868.901462:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000334464:0@lo:400:kworker.0 00010000:00080000:1.0:1787906868.901489:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53b04a680 x1874756000334592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906868.901499:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000334592:0@lo:400:kworker.0 00000100:00100000:2.0:1787906868.902239:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000333952 00000100:00100000:2.0:1787906868.902247:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000333952 00000100:00100000:2.0:1787906868.902299:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787906868.902307:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000333952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906868.902735:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000333952:12345-0@lo:400:kworker.0 Request processed in 428us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906868.902745:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787906868.902915:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000333952:0@lo:400:kworker.0 00000100:00100000:2.0:1787906869.408383:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa503050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000334720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787906869.408500:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906869.412246:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000334720 00000100:00100000:0.0:1787906869.412270:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000334720 00000100:00100000:0.0:1787906869.412371:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787906869.412385:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000334720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787906869.412444:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906869.416904:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000334720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4505us (8387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906869.416924:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787906869.417327:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa503050380 x1874756000334720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906869.417361:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa503050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000334720:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787906869.921310:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906870.944762:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906871.970514:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906871.972392:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5170a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000334848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906871.972564:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906871.973032:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000334848 00000100:00100000:0.0:1787906871.973054:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000334848 00000100:00080000:2.0:1787906871.973101:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906871.973140:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787906871.973154:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000334848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787906871.973208:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906871.973291:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000334848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906871.973300:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787906871.973335:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa5170a4e00 x1874756000334848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906871.973360:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5170a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000334848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787906872.994249:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906873.387141:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906873.387197:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906873.387229:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906873.387255:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906873.387309:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906873.387340:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971987456 00000100:00100000:0.0:1787906873.387350:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971987456 00000100:00100000:0.0:1787906873.387414:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971987584 00000100:00100000:0.0:1787906873.387417:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971987584 00000100:00100000:0.0:1787906873.387443:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:0.0:1787906873.387453:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755971987456:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906873.387526:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755971987456:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 73us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906873.387534:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:0.0:1787906873.387553:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:0.0:1787906873.387559:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971987584:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906873.387585:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971987584:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906873.387591:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:0.0:1787906873.387621:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971987200 00000100:00100000:0.0:1787906873.387625:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971987200 00000100:00100000:0.0:1787906873.387650:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971987328 00000100:00100000:0.0:1787906873.387654:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971987328 00000100:00100000:0.0:1787906873.387668:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 89 00000100:00100000:0.0:1787906873.387674:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755971987200:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906873.387704:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755971987200:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 30us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906873.387709:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 89 00000100:00100000:0.0:1787906873.387721:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:0.0:1787906873.387726:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971987328:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906873.387752:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971987328:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906873.387758:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00080000:0.0:1787906873.387778:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787906873.387782:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787906873.387784:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787906873.388275:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971987072 00000100:00100000:3.0:1787906873.388280:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971987072 00000100:00100000:3.0:1787906873.388324:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 230 00000100:00100000:3.0:1787906873.388331:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755971987072:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906873.388370:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755971987072:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906873.388377:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 230 00000100:00100000:2.0:1787906874.016715:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000335360:0@lo:400:kworker.0 00000100:00100000:0.0:1787906874.016838:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000334976:0@lo:400:kworker.0 00000100:00100000:2.0:1787906874.016866:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906874.017123:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000335360 00000100:00100000:1.0:1787906874.017133:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000335360 00000100:00100000:1.0:1787906874.017214:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787906874.017225:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000335360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906874.019827:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906874.019946:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000335488:0@lo:400:kworker.0 00000100:00100000:0.0:1787906874.020049:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787906874.020185:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906874.020216:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000335488 00000100:00100000:0.0:1787906874.020226:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000335488 00000100:00100000:0.0:1787906874.020292:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787906874.020305:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000335488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906874.020390:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000335488:12345-0@lo:400:kworker.0 Request processed in 88us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906874.020399:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1787906874.020426:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906874.020463:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000335488:0@lo:400:kworker.0 00000100:00100000:0.0:1787906874.022367:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000335232:0@lo:400:kworker.0 00000100:00100000:0.0:1787906874.022469:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906874.022985:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787906874.022994:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000335104:0@lo:400:kworker.0 00000100:00100000:0.0:1787906874.023024:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906874.023044:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000335616:0@lo:400:kworker.0 00000100:00100000:0.0:1787906874.023071:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906874.023898:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000335232 00000100:00100000:0.0:1787906874.023914:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000335232 00000100:00100000:0.0:1787906874.023987:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000335104 00000100:00100000:0.0:1787906874.023990:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000335104 00000100:00100000:0.0:1787906874.024010:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787906874.024020:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000335232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906874.024388:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000335232:12345-0@lo:400:kworker.0 Request processed in 367us (1917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906874.024397:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787906874.024419:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787906874.024426:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000335104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906874.024460:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000335104:12345-0@lo:400:kworker.0 Request processed in 33us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906874.024467:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787906874.025049:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000335616 00000100:00100000:0.0:1787906874.025056:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000335616 00000100:00100000:0.0:1787906874.025364:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787906874.025374:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000335616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906874.025434:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000335616:12345-0@lo:400:kworker.0 Request processed in 61us (2360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906874.025440:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787906874.025468:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787906874.025473:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906874.025876:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000335104:0@lo:400:kworker.0 00010000:00080000:0.0:1787906874.025894:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53b049180 x1874756000335616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906874.025905:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000335616:0@lo:400:kworker.0 00000100:00100000:0.0:1787906874.025920:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000335232:0@lo:400:kworker.0 00010000:00010000:3.0:1787906874.027001:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906874.027110:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000334976 00000100:00100000:2.0:1787906874.027121:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000334976 00000100:00100000:2.0:1787906874.027189:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787906874.027200:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000334976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906874.027288:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000334976:12345-0@lo:400:kworker.0 Request processed in 91us (7487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906874.027296:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787906874.027351:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000334976:0@lo:400:kworker.0 00000100:00100000:1.0:1787906874.029740:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000335360:12345-0@lo:400:kworker.0 Request processed in 12497us (12853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906874.029763:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787906874.029804:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53b04aa00 x1874756000335360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906874.029837:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000335360:0@lo:400:kworker.0 00000100:00100000:0.0:1787906874.530205:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000335744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787906874.530492:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906874.533156:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000335744 00000100:00100000:2.0:1787906874.533175:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000335744 00000100:00100000:2.0:1787906874.533258:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787906874.533271:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000335744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787906874.533325:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906874.533456:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000335744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 188us (3139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906874.533476:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787906874.537935:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53b048a80 x1874756000335744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906874.538037:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000335744:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906875.040041:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906876.063990:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906877.088081:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906877.092196:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787906877.092512:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5170a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000335872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787906877.092604:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906877.092732:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000335872 00000100:00100000:3.0:1787906877.092742:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000335872 00000100:00100000:3.0:1787906877.092858:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787906877.092869:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000335872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787906877.092912:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906877.092966:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000335872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906877.092973:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787906877.093257:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787906877.093305:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa5170a4e00 x1874756000335872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906877.093352:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5170a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000335872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787906878.119262:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906878.484515:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906878.484621:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906878.484654:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906878.484673:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906878.484711:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906878.501863:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971987840 00000100:00100000:0.0:1787906878.501883:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971987840 00000100:00100000:0.0:1787906878.501992:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971987968 00000100:00100000:0.0:1787906878.501997:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971987968 00000100:00100000:0.0:1787906878.502024:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:0.0:1787906878.502036:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755971987840:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906878.502141:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755971987840:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 106us (17642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906878.502149:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:0.0:1787906878.502170:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00100000:0.0:1787906878.502178:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755971987968:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906878.502203:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755971987968:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (17492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906878.502210:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00100000:0.0:1787906878.502240:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971987712 00000100:00100000:0.0:1787906878.502244:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971987712 00000100:00100000:0.0:1787906878.502271:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 232 00000100:00100000:0.0:1787906878.502278:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755971987712:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906878.502303:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755971987712:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (17683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906878.502309:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 232 00000100:00100000:0.0:1787906878.502341:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971988096 00000100:00100000:0.0:1787906878.502346:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971988096 00000100:00100000:0.0:1787906878.502379:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971988224 00000100:00100000:0.0:1787906878.502383:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971988224 00000100:00100000:0.0:1787906878.502407:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:0.0:1787906878.502414:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2342:x1874755971988096:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:0.0:1787906878.502438:0:8459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad322 00000100:00080000:0.0:1787906878.502449:0:8459:0:(import.c:65:import_set_state_nolock()) ffff8aa534c98800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787906878.502793:0:8459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787906878.503214:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0090c414-ebc1-4e0b-a520-0378a8ae450c+2:2342:x1874755971988096:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 797us (18556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906878.503223:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:0.0:1787906878.503242:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:0.0:1787906878.503250:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2342:x1874755971988224:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:0.0:1787906878.503268:0:8459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad329 00000100:00080000:0.0:1787906878.503275:0:8459:0:(import.c:65:import_set_state_nolock()) ffff8aa534c9d800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1787906878.503293:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787906878.503299:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787906878.503302:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:0.0:1787906878.503304:0:8459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787906878.505904:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0090c414-ebc1-4e0b-a520-0378a8ae450c+2:2342:x1874755971988224:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 2642us (21217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906878.505919:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00010000:00010000:0.0:1787906878.505955:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906878.505961:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906879.136246:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906879.136488:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5170a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000336128:0@lo:400:kworker.0 00000100:00100000:0.0:1787906879.136622:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906879.136705:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000336640:0@lo:400:kworker.0 00000100:00100000:0.0:1787906879.136734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906879.136783:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787906879.136790:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510b80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000336256:0@lo:400:kworker.0 00000100:00100000:0.0:1787906879.136892:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906879.136933:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000336128 00000100:00100000:0.0:1787906879.136947:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000336128 00000100:00100000:0.0:1787906879.137023:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000336256 00000100:00100000:0.0:1787906879.137026:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000336256 00000100:00100000:0.0:1787906879.137061:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787906879.137071:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000336128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906879.137229:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510b83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000336384:0@lo:400:kworker.0 00000100:00100000:3.0:1787906879.137268:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906879.137295:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787906879.137301:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5170a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000336000:0@lo:400:kworker.0 00000100:00100000:3.0:1787906879.137334:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906879.137358:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510b80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000336512:0@lo:400:kworker.0 00000100:00100000:3.0:1787906879.137393:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906879.137476:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787906879.137488:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787906879.137633:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000336128:12345-0@lo:400:kworker.0 Request processed in 562us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906879.137642:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787906879.137661:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000336512 00000100:00100000:0.0:1787906879.137664:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000336512 00000100:00100000:0.0:1787906879.137684:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787906879.137690:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000336256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906879.137717:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000336256:12345-0@lo:400:kworker.0 Request processed in 27us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906879.137723:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787906879.137733:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787906879.137738:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000336512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906879.137781:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000336512:12345-0@lo:400:kworker.0 Request processed in 42us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906879.137788:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1787906879.137805:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906879.137848:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000336640 00000100:00100000:0.0:1787906879.137853:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000336640 00000100:00100000:0.0:1787906879.137885:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000336384 00000100:00100000:0.0:1787906879.137888:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000336384 00000100:00100000:0.0:1787906879.137909:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787906879.137925:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000336640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906879.137961:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000336640:12345-0@lo:400:kworker.0 Request processed in 39us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906879.137968:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787906879.137979:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787906879.137985:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000336384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906879.138014:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000336384:12345-0@lo:400:kworker.0 Request processed in 29us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906879.138020:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787906879.138037:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000336000 00000100:00100000:0.0:1787906879.138040:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000336000 00000100:00100000:0.0:1787906879.138064:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787906879.138070:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000336000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906879.138113:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000336000:12345-0@lo:400:kworker.0 Request processed in 43us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906879.138119:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:0.0:1787906879.138158:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787906879.138160:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787906879.138197:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5170a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000336000:0@lo:400:kworker.0 00000100:00100000:0.0:1787906879.138213:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510b80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000336512:0@lo:400:kworker.0 00010000:00080000:0.0:1787906879.138226:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510b83480 x1874756000336384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906879.138237:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510b83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000336384:0@lo:400:kworker.0 00000100:00100000:2.0:1787906879.140299:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5170a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000336128:0@lo:400:kworker.0 00010000:00080000:2.0:1787906879.140333:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510b81f80 x1874756000336640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906879.140347:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000336640:0@lo:400:kworker.0 00000100:00100000:2.0:1787906879.140390:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510b80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000336256:0@lo:400:kworker.0 00000100:00100000:0.0:1787906879.648508:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787906879.648541:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000336768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787906879.648649:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906879.649061:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000336768 00000100:00100000:3.0:1787906879.649074:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000336768 00000100:00100000:3.0:1787906879.649150:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787906879.649163:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000336768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787906879.649213:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906879.649320:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000336768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906879.649328:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787906879.650219:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53b04b100 x1874756000336768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906879.650257:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000336768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787906880.160164:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906881.184412:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787906881.771011:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0090c414-ebc1-4e0b-a520-0378a8ae450c 00000020:00000080:3.0:1787906881.771025:0:7636:0:(genops.c:885:class_export_put()) final put ffff8aa534c99800/0090c414-ebc1-4e0b-a520-0378a8ae450c 00000020:00000080:3.0:1787906881.771062:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa534c99800/0090c414-ebc1-4e0b-a520-0378a8ae450c for lustre-OST0001 00000020:00000080:3.0:1787906881.771128:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa534c9d800 for lustre-OST0001 00000100:00100000:0.0:1787906882.208092:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787906882.208131:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510b80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000336896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787906882.208222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906882.208296:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000336896 00000100:00100000:0.0:1787906882.208306:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000336896 00000100:00100000:0.0:1787906882.208386:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787906882.208396:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000336896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787906882.208447:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906882.208507:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000336896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906882.208515:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1787906882.208540:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787906882.208576:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510b80e00 x1874756000336896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906882.208599:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510b80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000336896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787906882.208877:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906883.233141:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787906883.346317:0:6699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0090c414-ebc1-4e0b-a520-0378a8ae450c 00000020:00000080:3.0:1787906883.346334:0:6699:0:(genops.c:885:class_export_put()) final put ffff8aa534c9f800/0090c414-ebc1-4e0b-a520-0378a8ae450c 00000020:00000080:3.0:1787906883.346526:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa534c9f800/0090c414-ebc1-4e0b-a520-0378a8ae450c for lustre-OST0000 00000020:00000080:3.0:1787906883.346589:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa534c98800 for lustre-OST0000 00000100:00100000:1.0:1787906883.597390:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906883.597453:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906883.597497:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906883.597529:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971988352 00000100:00100000:1.0:1787906883.597541:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971988352 00000100:00100000:1.0:1787906883.597612:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 234 00000100:00100000:1.0:1787906883.597624:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755971988352:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906883.597750:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755971988352:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 127us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906883.597759:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 234 00000100:00100000:1.0:1787906883.597802:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971988480 00000100:00100000:1.0:1787906883.597807:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971988480 00000100:00100000:1.0:1787906883.597870:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971988608 00000100:00100000:1.0:1787906883.597873:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971988608 00000100:00100000:1.0:1787906883.597895:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:1.0:1787906883.597902:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755971988480:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906883.597939:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755971988480:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 37us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906883.597945:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:1.0:1787906883.597957:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:1.0:1787906883.597963:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755971988608:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906883.597987:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755971988608:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906883.598017:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00080000:1.0:1787906883.598161:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787906884.036513:0:11020:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787906884.264537:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000337024:0@lo:400:kworker.0 00000100:00100000:3.0:1787906884.264611:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906884.264673:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000337536:0@lo:400:kworker.0 00000100:00100000:3.0:1787906884.264702:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906884.264732:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787906884.264738:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000337408:0@lo:400:kworker.0 00000100:00100000:3.0:1787906884.264765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906884.264796:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000337152:0@lo:400:kworker.0 00000100:00100000:3.0:1787906884.264861:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906884.264881:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000337664:0@lo:400:kworker.0 00000100:00100000:3.0:1787906884.264900:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906884.264921:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787906884.264927:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000337280:0@lo:400:kworker.0 00000100:00100000:3.0:1787906884.264947:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906884.264983:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000337024 00000100:00100000:3.0:1787906884.264990:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000337024 00000100:00100000:3.0:1787906884.265034:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787906884.265043:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000337024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906884.265102:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000337024:12345-0@lo:400:kworker.0 Request processed in 60us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906884.265109:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787906884.265140:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000337536 00000100:00100000:3.0:1787906884.265143:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000337536 00000100:00100000:3.0:1787906884.266940:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000337152 00000100:00100000:3.0:1787906884.266958:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000337152 00000100:00100000:3.0:1787906884.266999:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000337280 00000100:00100000:3.0:1787906884.267003:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000337280 00000100:00100000:3.0:1787906884.267036:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787906884.267049:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000337536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906884.267554:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000337536:12345-0@lo:400:kworker.0 Request processed in 507us (2850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906884.267563:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787906884.267583:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787906884.267593:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000337152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906884.267649:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000337152:12345-0@lo:400:kworker.0 Request processed in 59us (2786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906884.267673:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787906884.267687:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787906884.267694:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000337280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906884.267728:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000337280:12345-0@lo:400:kworker.0 Request processed in 35us (2779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906884.267733:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787906884.267761:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000337408 00000100:00100000:3.0:1787906884.267765:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000337408 00000100:00100000:2.0:1787906884.267965:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000337280:0@lo:400:kworker.0 00000100:00100000:2.0:1787906884.267980:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000337152:0@lo:400:kworker.0 00000100:00100000:2.0:1787906884.269501:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000337664 00000100:00100000:2.0:1787906884.269515:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000337664 00000100:00100000:2.0:1787906884.269581:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787906884.269592:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000337408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906884.269695:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000337408:12345-0@lo:400:kworker.0 Request processed in 106us (4928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906884.269702:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787906884.269718:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787906884.269731:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000337664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906884.269773:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000337664:12345-0@lo:400:kworker.0 Request processed in 42us (4870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906884.269780:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787906884.269868:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534a0a300 x1874756000337664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906884.269884:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000337664:0@lo:400:kworker.0 00010000:00080000:2.0:1787906884.269933:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534a08a80 x1874756000337408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906884.269944:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000337408:0@lo:400:kworker.0 00000100:00100000:2.0:1787906884.269960:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000337024:0@lo:400:kworker.0 00000100:00100000:2.0:1787906884.269974:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000337536:0@lo:400:kworker.0 00000100:00080000:3.0:1787906884.270263:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787906884.270269:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787906884.270273:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787906884.274022:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906884.769303:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000337792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787906884.769410:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906884.770238:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000337792 00000100:00100000:1.0:1787906884.770252:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000337792 00000100:00100000:1.0:1787906884.770319:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787906884.770333:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000337792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787906884.770380:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906884.770456:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000337792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906884.770464:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787906884.770520:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53b04b100 x1874756000337792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906884.770548:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000337792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906885.279981:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906886.305349:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906887.330372:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000337920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787906887.330442:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906887.330649:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000337920 00000100:00100000:3.0:1787906887.330659:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000337920 00000100:00100000:3.0:1787906887.330720:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787906887.330730:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000337920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787906887.330769:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906887.330845:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000337920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906887.330852:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787906887.331358:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787906887.331671:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534a09500 x1874756000337920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906887.331699:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000337920:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787906887.332043:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906888.356084:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906888.716594:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906888.716657:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906888.716687:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906888.716715:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971988736 00000100:00100000:3.0:1787906888.716725:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971988736 00000100:00100000:3.0:1787906888.716773:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 236 00000100:00100000:3.0:1787906888.716784:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755971988736:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906888.716842:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971988864 00000100:00100000:2.0:1787906888.716848:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971988864 00000100:00100000:3.0:1787906888.716877:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755971988736:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 93us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906888.716885:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 236 00000100:00100000:2.0:1787906888.716909:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971988992 00000100:00100000:2.0:1787906888.716913:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971988992 00000100:00100000:2.0:1787906888.716944:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 104 00000100:00100000:2.0:1787906888.716954:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755971988864:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906888.716992:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755971988864:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 40us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906888.716998:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 104 00000100:00100000:2.0:1787906888.717013:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 105 00000100:00100000:2.0:1787906888.717033:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971988992:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:3.0:1787906888.717059:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906888.717068:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971988992:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 35us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906888.717074:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 105 00000100:00100000:1.0:1787906889.377403:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000338432:0@lo:400:kworker.0 00000100:00100000:1.0:1787906889.377480:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906889.377564:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787906889.377570:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000338048:0@lo:400:kworker.0 00000100:00100000:1.0:1787906889.377604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906889.377629:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000338560:0@lo:400:kworker.0 00000100:00100000:1.0:1787906889.377655:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906889.377684:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000338304:0@lo:400:kworker.0 00000100:00100000:1.0:1787906889.377709:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906889.377730:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787906889.377735:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000338176:0@lo:400:kworker.0 00000100:00100000:1.0:1787906889.377758:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906889.377774:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000338688:0@lo:400:kworker.0 00000100:00100000:1.0:1787906889.377794:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906889.377840:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000338560 00000100:00100000:1.0:1787906889.377855:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000338560 00000100:00100000:1.0:1787906889.377906:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000338304 00000100:00100000:1.0:1787906889.377910:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000338304 00000100:00100000:1.0:1787906889.377926:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000338176 00000100:00100000:1.0:1787906889.377928:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000338176 00000100:00100000:1.0:1787906889.377942:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787906889.377951:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000338560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906889.378005:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000338560:12345-0@lo:400:kworker.0 Request processed in 55us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906889.378013:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787906889.378029:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787906889.378034:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000338304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906889.378063:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000338304:12345-0@lo:400:kworker.0 Request processed in 29us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906889.378069:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787906889.378078:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787906889.378084:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000338176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906889.378106:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000338176:12345-0@lo:400:kworker.0 Request processed in 23us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906889.378111:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1787906889.378128:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906889.378159:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000338176:0@lo:400:kworker.0 00000100:00100000:1.0:1787906889.378169:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000338304:0@lo:400:kworker.0 00000100:00100000:1.0:1787906889.378212:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000338560:0@lo:400:kworker.0 00000100:00100000:3.0:1787906889.379006:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000338048 00000100:00100000:3.0:1787906889.379013:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000338048 00000100:00100000:3.0:1787906889.379059:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787906889.379067:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000338048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906889.379115:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000338048:12345-0@lo:400:kworker.0 Request processed in 49us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906889.379121:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787906889.379152:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000338432 00000100:00100000:3.0:1787906889.379155:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000338432 00000100:00100000:3.0:1787906889.379184:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000338688 00000100:00100000:3.0:1787906889.379249:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000338688 00000100:00100000:3.0:1787906889.379277:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787906889.379292:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000338432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906889.379324:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000338432:12345-0@lo:400:kworker.0 Request processed in 34us (1845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906889.379330:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787906889.379342:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787906889.379348:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000338688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906889.379378:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000338688:12345-0@lo:400:kworker.0 Request processed in 30us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906889.379384:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787906889.379413:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787906889.379416:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787906889.379436:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa520afc000 x1874756000338688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906889.379448:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000338688:0@lo:400:kworker.0 00000100:00100000:3.0:1787906889.380378:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000338048:0@lo:400:kworker.0 00010000:00080000:3.0:1787906889.380394:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa520afd180 x1874756000338432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906889.380405:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000338432:0@lo:400:kworker.0 00010000:00010000:0.0:1787906889.386725:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787906889.478422:0:11170:0:(class_obd.c:354:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb6c682f0 20000000:00000080:0.0:1787906889.478445:0:11170:0:(mgs_handler.c:1205:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8aa541cbc400 uarg=0000000000000000 20000000:01000000:0.0:1787906889.478494:0:11170:0:(mgs_llog.c:6200:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787906889.478503:0:11170:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787906889.478518:0:11170:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787906889.490866:0:11171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787906889.491283:0:11170:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787906889.511099:0:11170:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787906889.511131:0:11170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.511152:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad2d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef568 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.511161:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cad2e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad2dc expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.511168:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa541c96c00/0x72bb6cf063cad2f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad2ea expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.511174:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa541c96200/0x72bb6cf063cad2ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad2f8 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.511180:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad314 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5a0 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.511187:0:11170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.511234:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5a0 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.511271:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad314 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5a0 expref: 12 pid: 5825 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906889.511290:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874756000338816:192.168.204.20@tcp:104: 00010000:00010000:2.0:1787906889.517202:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa541c96200/0x72bb6cf063cad2ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad2f8 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.517220:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa541c96200/0x72bb6cf063cad2ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad2f8 expref: 18 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906889.517235:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874756000338944:0@lo:104: 00000100:00100000:2.0:1787906889.517305:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787906889.517345:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa541c96c00/0x72bb6cf063cad2f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad2ea expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.517354:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa541c96c00/0x72bb6cf063cad2f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad2ea expref: 18 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906889.517362:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b048a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874756000339072:0@lo:104: 00000100:00100000:2.0:1787906889.517385:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787906889.517412:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cad2e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad2dc expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.517419:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cad2e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad2dc expref: 18 pid: 5823 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906889.517427:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874756000339200:0@lo:104: 00000100:00100000:2.0:1787906889.517448:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906889.517518:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000338944 00000100:00100000:2.0:1787906889.517527:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000338944 00000100:00100000:2.0:1787906889.517581:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000339072 00000100:00100000:2.0:1787906889.517584:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000339072 00000100:00100000:2.0:1787906889.517594:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000339200 00000100:00100000:2.0:1787906889.517596:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000339200 00000100:00100000:2.0:1787906889.517608:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787906889.517617:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+5:11170:x1874756000338944:12345-0@lo:104: 00010000:00010000:2.0:1787906889.517630:0:6688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad2ff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.517681:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787906889.517688:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+5:11170:x1874756000338944:12345-0@lo:104: Request processed in 72us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906889.517695:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787906889.517714:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787906889.517721:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:11170:x1874756000339072:12345-0@lo:104: 00010000:00010000:2.0:1787906889.517728:0:6688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad2f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.517766:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787906889.517771:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:11170:x1874756000339072:12345-0@lo:104: Request processed in 52us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906889.517777:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787906889.517789:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787906889.517795:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b049180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:11170:x1874756000339200:12345-0@lo:104: 00010000:00010000:2.0:1787906889.517802:0:6688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad2e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.517882:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787906889.517887:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b049180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:11170:x1874756000339200:12345-0@lo:104: Request processed in 92us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906889.517893:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787906889.517911:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787906889.517917:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad2ff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.517925:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96000 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:2.0:1787906889.517930:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad2ff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.517938:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad2ff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787906889.517945:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad2ff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906889.517951:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787906889.517978:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad2ff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.517985:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787906889.518003:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad2ff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.518010:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cad2f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad2ff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.518034:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787906889.518037:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad2f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.518043:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96e00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:2.0:1787906889.518046:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad2f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.518053:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad2f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787906889.518060:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad2f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906889.518065:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787906889.518078:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad2f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.518084:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787906889.518098:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad2f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.518104:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad2ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad2f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.518113:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787906889.518116:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad2e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.518131:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97800 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:2.0:1787906889.518134:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad2e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.518141:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad2e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787906889.518147:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad2e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906889.518152:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787906889.518165:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad2e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.518171:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787906889.518177:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad2e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.518183:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad2dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad2e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.518196:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906889.518198:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906889.518199:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906889.518232:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad2d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef568 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.518242:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad2d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef568 expref: 12 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906889.518265:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874756000339712:192.168.204.20@tcp:104: 00000100:00100000:2.0:1787906889.518314:0:11170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed82780 going to sleep for 11 seconds 00000100:00100000:2.0:1787906889.518339:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874756000338944:0@lo:104: 00000100:00100000:2.0:1787906889.518349:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b048a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874756000339072:0@lo:104: 00000100:00100000:2.0:1787906889.518356:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874756000339200:0@lo:104: 00010000:00010000:0.0:1787906889.518612:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906889.518696:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906889.518709:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000339328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787906889.518756:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906889.519196:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000339328 00000100:00100000:2.0:1787906889.519202:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000339328 00010000:00010000:2.0:1787906889.519227:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa541c96200/0x72bb6cf063cad2ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad2f8 expref: 19 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906889.519251:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787906889.519257:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510224c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3301:x1874756000339328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787906889.519283:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906889.519289:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa541c96200/0x72bb6cf063cad2ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad2f8 expref: 19 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.519299:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa541c96200/0x72bb6cf063cad2ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad2f8 expref: 19 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.519312:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa541c96200/0x72bb6cf063cad2ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad2f8 expref: 19 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.519326:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906889.519445:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510224c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:3301:x1874756000339328:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906889.519453:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787906889.519582:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906889.519599:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000339456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787906889.519628:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906889.519662:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787906889.519667:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000339584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787906889.519688:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906889.519902:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000339456 00000100:00100000:1.0:1787906889.519908:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000339456 00010000:00010000:1.0:1787906889.519927:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa541c96c00/0x72bb6cf063cad2f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad2ea expref: 18 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906889.519951:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000339584 00000100:00100000:1.0:1787906889.519955:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000339584 00010000:00010000:1.0:1787906889.519965:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cad2e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad2dc expref: 19 pid: 5823 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906889.519983:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787906889.519989:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000339456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787906889.519996:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906889.520000:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa541c96c00/0x72bb6cf063cad2f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad2ea expref: 19 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906889.520007:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa541c96c00/0x72bb6cf063cad2f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad2ea expref: 19 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906889.520017:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa541c96c00/0x72bb6cf063cad2f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad2ea expref: 19 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906889.520025:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906889.520056:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:3303:x1874756000339456:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906889.520061:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787906889.520073:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787906889.520079:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:3303:x1874756000339584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787906889.520095:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906889.520099:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cad2e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad2dc expref: 17 pid: 5823 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906889.520108:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cad2e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad2dc expref: 17 pid: 5823 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906889.520117:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cad2e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad2dc expref: 17 pid: 5823 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906889.520126:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906889.520148:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:3303:x1874756000339584:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906889.520154:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787906889.520182:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000339584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787906889.520191:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000339456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787906889.520714:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000339328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787906889.523269:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874756000338816:192.168.204.20@tcp:104: 00000100:00100000:2.0:1787906889.523286:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1874756000339712:192.168.204.20@tcp:104: 00010000:00010000:2.0:1787906889.523330:0:11170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906889.523386:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906889.523501:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971989120 00000100:00100000:1.0:1787906889.523509:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971989120 00010000:00010000:1.0:1787906889.523543:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad314 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5a0 expref: 13 pid: 5825 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906889.523590:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:1.0:1787906889.523599:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755971989120:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906889.523616:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906889.523622:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad314 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5a0 expref: 13 pid: 5825 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906889.523634:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5a0 expref: 13 pid: 5825 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906889.523666:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511995400/0x72bb6cf063cad314 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5a0 expref: 13 pid: 5825 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906889.523693:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906889.523754:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9eec00eb-d19d-4892-ad44-299469e66291+12:2346:x1874755971989120:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 156us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906889.523762:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:3.0:1787906889.524345:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906889.524891:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971989248 00000100:00100000:2.0:1787906889.524899:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971989248 00010000:00010000:2.0:1787906889.524923:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad2d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef568 expref: 12 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906889.524951:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:2.0:1787906889.524959:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9eec00eb-d19d-4892-ad44-299469e66291+12:2346:x1874755971989248:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906889.524969:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906889.524974:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad2d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef568 expref: 12 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.524984:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad2d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef568 expref: 12 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.524997:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad2d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef568 expref: 12 pid: 5823 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.525012:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.525020:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.525033:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.525049:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.525056:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.525063:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.525069:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787906889.525073:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.525082:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.525095:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.525104:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906889.525134:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9eec00eb-d19d-4892-ad44-299469e66291+11:2346:x1874755971989248:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 177us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906889.525141:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00010000:00010000:2.0:1787906889.525163:0:11170:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.525171:0:11170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906889.525177:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa541c97a00/0x72bb6cf063cad330 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906889.891347:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787906889.891389:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000339840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787906889.891502:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906889.891737:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000339840 00000100:00100000:1.0:1787906889.891755:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000339840 00000100:00100000:1.0:1787906889.891892:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787906889.891903:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000339840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787906889.891941:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906889.892012:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000339840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906889.892020:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787906889.892387:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53b049f80 x1874756000339840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906889.892408:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000339840:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787906890.401071:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906890.638550:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906890.647300:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971989376 00000100:00100000:0.0:1787906890.647322:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971989376 00000100:00100000:0.0:1787906890.647403:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 238 00000100:00100000:0.0:1787906890.647414:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+11:5589:x1874755971989376:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787906890.647437:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906890.647460:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa53ac8f400/0x72bb6cf063cad337 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef5ca expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906890.647493:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa53ac8f400/0x72bb6cf063cad337 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5ca expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906890.647505:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa53ac8f400/0x72bb6cf063cad337 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5ca expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906890.647514:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f400, rc 0) 00000100:00100000:0.0:1787906890.647617:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+12:5589:x1874755971989376:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 204us (9089us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906890.647625:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 238 00000100:00100000:0.0:1787906890.661959:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906890.662151:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971989504 00000100:00100000:1.0:1787906890.662161:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971989504 00000100:00100000:1.0:1787906890.662213:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 239 00000100:00100000:1.0:1787906890.662224:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+12:5589:x1874755971989504:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906890.662549:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+12:5589:x1874755971989504:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 326us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906890.662557:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 239 00000100:00100000:0.0:1787906890.669899:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906890.669995:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971989632 00000100:00100000:2.0:1787906890.670005:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971989632 00000100:00100000:2.0:1787906890.670059:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 240 00000100:00100000:2.0:1787906890.670070:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+12:5589:x1874755971989632:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906890.670318:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+12:5589:x1874755971989632:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 250us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906890.670326:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 240 00000100:00100000:2.0:1787906890.681116:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906890.681367:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971989760 00000100:00100000:0.0:1787906890.681377:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971989760 00000100:00100000:0.0:1787906890.681432:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 241 00000100:00100000:0.0:1787906890.681443:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+12:5589:x1874755971989760:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787906890.681477:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906890.681496:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad33e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef5d1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906890.681524:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad33e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5d1 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906890.681632:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad33e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5d1 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906890.681654:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f200, rc 0) 00000100:00100000:0.0:1787906890.681713:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:5589:x1874755971989760:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 272us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906890.681720:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 241 00000100:00100000:0.0:1787906890.686895:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906890.687927:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971989888 00000100:00100000:3.0:1787906890.687939:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971989888 00000100:00100000:3.0:1787906890.687990:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 242 00000100:00100000:3.0:1787906890.688000:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:5589:x1874755971989888:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787906890.690173:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:5589:x1874755971989888:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 2161us (3273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906890.690190:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 242 00000100:00100000:1.0:1787906890.712077:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906890.712156:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971990016 00000100:00100000:2.0:1787906890.712166:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971990016 00000100:00100000:2.0:1787906890.712227:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 243 00000100:00100000:2.0:1787906890.712238:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:5589:x1874755971990016:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906890.712481:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:5589:x1874755971990016:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 244us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906890.712490:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 243 10000000:01000000:2.0:1787906891.103907:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787906891.103916:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa401350800 from 7 10000000:01000000:2.0:1787906891.103922:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787906891.104076:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906891.104102:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906891.104115:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906891.104142:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000339968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787906891.104210:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906891.104266:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787906891.104565:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000339968 00000100:00100000:3.0:1787906891.104574:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000339968 00000100:00100000:3.0:1787906891.104628:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787906891.104651:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000339968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787906891.106257:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906891.106278:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa500031200/0x72bb6cf063cad34c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad345 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906891.106308:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa500031200/0x72bb6cf063cad34c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad345 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906891.106321:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa500031200/0x72bb6cf063cad34c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad345 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906891.106331:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031200, rc 0) 00000100:00100000:3.0:1787906891.106432:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000339968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1793us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906891.106440:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787906891.107721:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000339968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787906891.107750:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad34c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906891.107763:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad34c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906891.107986:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906891.108044:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906891.108095:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787906891.108205:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000340096 00000100:00100000:3.0:1787906891.108212:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000340096 00000100:00100000:3.0:1787906891.108261:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787906891.108270:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000340096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787906891.108607:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000340096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906891.108615:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787906891.108735:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906891.108773:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787906891.109001:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906891.109025:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787906891.109093:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000340224 00000100:00100000:3.0:1787906891.109098:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000340224 00000100:00100000:3.0:1787906891.109173:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787906891.109181:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000340224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787906891.109336:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000340224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906891.109344:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787906891.109421:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787906891.110296:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787906891.110345:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787906891.110360:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787906891.110369:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad34c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906891.110391:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad34c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906891.110401:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787906891.110403:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa510341800 from 7 10000000:01000000:2.0:1787906891.110406:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787906891.110433:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906891.110441:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906891.110450:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906891.110466:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787906891.110508:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906891.110997:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed82000 going to sleep for 11 seconds 00000100:00100000:1.0:1787906891.111081:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000340352 00000100:00100000:1.0:1787906891.111089:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000340352 00000100:00100000:1.0:1787906891.111122:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787906891.111131:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000340352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787906891.111142:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906891.111154:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cad35a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad353 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906891.111176:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cad35a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad353 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906891.111187:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cad35a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad353 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906891.111196:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211a00, rc 0) 00000100:00100000:1.0:1787906891.111252:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000340352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906891.111260:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787906891.111311:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787906891.111324:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad35a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906891.111333:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad35a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906891.111376:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906891.111408:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906891.111423:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787906891.111434:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000340480 00000100:00100000:1.0:1787906891.111437:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000340480 00000100:00100000:1.0:1787906891.111453:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787906891.111459:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000340480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906891.111703:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000340480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906891.111710:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787906891.111739:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906891.111766:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787906891.111803:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906891.112008:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787906891.112022:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000340608 00000100:00100000:1.0:1787906891.112026:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000340608 00000100:00100000:1.0:1787906891.112046:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787906891.112052:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000340608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787906891.112203:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000340608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906891.112211:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787906891.112268:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787906891.113160:0:11206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787906891.113212:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787906891.113227:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787906891.113237:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad35a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906891.113253:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad35a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787906891.113263:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787906891.113265:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa51a4db800 from 7 10000000:01000000:1.0:1787906891.113268:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787906891.113295:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906891.113303:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906891.113313:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906891.113330:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787906891.113371:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906891.113403:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906891.113420:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000340736 00000100:00100000:1.0:1787906891.113425:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000340736 00000100:00100000:1.0:1787906891.113451:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787906891.113460:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000340736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787906891.113470:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906891.113481:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa508210600/0x72bb6cf063cad368 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad361 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906891.113502:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508210600/0x72bb6cf063cad368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad361 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906891.113534:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa508210600/0x72bb6cf063cad368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad361 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906891.113543:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508210600, rc 0) 00000100:00100000:1.0:1787906891.113582:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000340736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906891.113589:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787906891.113625:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787906891.113637:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad368 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906891.113646:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad368 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906891.113702:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906891.113733:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906891.113746:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510af4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906891.113757:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000340864 00000100:00100000:1.0:1787906891.113760:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000340864 00000100:00100000:1.0:1787906891.113776:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787906891.113782:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000340864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906891.114198:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000340864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 414us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906891.114206:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787906891.114244:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906891.114300:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787906891.114342:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906891.114377:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa508a42a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906891.114391:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000340992 00000100:00100000:1.0:1787906891.114395:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000340992 00000100:00100000:1.0:1787906891.114416:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787906891.114424:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000340992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787906891.114768:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000340992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 344us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906891.114774:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787906891.116026:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000340992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787906891.116705:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787906891.116760:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787906891.116776:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787906891.116786:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad368 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906891.116797:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad368 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906891.425743:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906892.448346:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000341120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787906892.448447:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906892.448547:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000341120 00000100:00100000:1.0:1787906892.448555:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000341120 00000100:00100000:1.0:1787906892.448617:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787906892.448628:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000341120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787906892.448667:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906892.448719:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000341120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906892.448726:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1787906892.448763:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53aca0000 x1874756000341120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906892.448783:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000341120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787906892.448846:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787906892.448856:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787906893.473858:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787906893.779069:0:11368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787906893.834222:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906893.834262:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906893.834302:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906893.834342:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971990400 00000100:00100000:0.0:1787906893.834354:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971990400 00000100:00100000:0.0:1787906893.834430:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971990272 00000100:00100000:0.0:1787906893.834434:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971990272 00000100:00100000:0.0:1787906893.834461:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 109 00000100:00100000:0.0:1787906893.834482:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971990400:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906893.834567:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971990400:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 96us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906893.834574:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 109 00000100:00100000:0.0:1787906893.834601:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 110 00000100:00100000:0.0:1787906893.834608:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755971990272:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906893.834634:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755971990272:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906893.834640:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 110 00000100:00080000:0.0:1787906893.834656:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906893.835862:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971990144 00000100:00100000:3.0:1787906893.835872:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971990144 00000100:00100000:3.0:1787906893.835963:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 253 00000100:00100000:3.0:1787906893.835973:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755971990144:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906893.836030:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755971990144:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 59us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906893.836037:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 253 00010000:00010000:2.0:1787906894.503288:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906894.504504:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000341248:0@lo:400:kworker.0 00000100:00100000:0.0:1787906894.504742:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000341632:0@lo:400:kworker.0 00000100:00100000:0.0:1787906894.504895:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906894.504992:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787906894.505004:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000341504:0@lo:400:kworker.0 00000100:00100000:0.0:1787906894.505054:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906894.506075:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000341504 00000100:00100000:0.0:1787906894.506094:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000341504 00000100:00100000:0.0:1787906894.506202:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787906894.506218:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000341504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906894.506318:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906894.506353:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000341760:0@lo:400:kworker.0 00000100:00100000:1.0:1787906894.506382:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906894.506404:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787906894.506410:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000341376:0@lo:400:kworker.0 00000100:00100000:1.0:1787906894.506432:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906894.506450:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000341888:0@lo:400:kworker.0 00000100:00100000:1.0:1787906894.506488:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906894.506560:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000341504:12345-0@lo:400:kworker.0 Request processed in 344us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906894.506572:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787906894.506699:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000341760 00000100:00100000:0.0:1787906894.506720:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000341760 00000100:00100000:0.0:1787906894.506759:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000341376 00000100:00100000:0.0:1787906894.506765:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000341376 00000100:00100000:0.0:1787906894.506792:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787906894.506804:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000341760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906894.506907:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000341760:12345-0@lo:400:kworker.0 Request processed in 103us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906894.506919:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787906894.506965:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787906894.506978:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000341376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906894.507030:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000341376:12345-0@lo:400:kworker.0 Request processed in 56us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906894.507039:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787906894.511585:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000341248 00000100:00100000:2.0:1787906894.511613:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000341248 00000100:00100000:2.0:1787906894.511689:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787906894.511702:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000341248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906894.511862:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000341248:12345-0@lo:400:kworker.0 Request processed in 163us (5543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906894.511870:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787906894.512394:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000341632 00000100:00100000:2.0:1787906894.512419:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000341632 00000100:00100000:2.0:1787906894.512477:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000341888 00000100:00100000:2.0:1787906894.512481:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000341888 00000100:00100000:2.0:1787906894.512507:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787906894.512514:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000341632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906894.512565:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000341632:12345-0@lo:400:kworker.0 Request processed in 52us (7672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906894.512573:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787906894.512587:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787906894.512593:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000341888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906894.512624:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000341888:12345-0@lo:400:kworker.0 Request processed in 32us (6136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906894.512629:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787906894.513089:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000341376:0@lo:400:kworker.0 00010000:00080000:2.0:1787906894.513109:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53b049f80 x1874756000341888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906894.513122:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000341888:0@lo:400:kworker.0 00000100:00100000:2.0:1787906894.513135:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000341248:0@lo:400:kworker.0 00000100:00100000:2.0:1787906894.513148:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000341760:0@lo:400:kworker.0 00000100:00100000:3.0:1787906894.517144:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000341504:0@lo:400:kworker.0 00010000:00080000:3.0:1787906894.517170:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53b048e00 x1874756000341632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906894.517183:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000341632:0@lo:400:kworker.0 00000100:00080000:0.0:1787906894.519138:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787906894.519147:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787906894.519150:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906895.009257:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787906895.009295:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000342016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787906895.009377:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906895.009872:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000342016 00000100:00100000:1.0:1787906895.009892:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000342016 00000100:00100000:1.0:1787906895.009955:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787906895.009965:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000342016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787906895.010007:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906895.010080:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000342016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906895.010088:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787906895.010240:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53b049880 x1874756000342016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906895.010261:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000342016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906895.520863:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906896.547832:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906897.568675:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000342144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906897.568762:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906897.568940:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000342144 00000100:00100000:1.0:1787906897.568951:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000342144 00000100:00100000:1.0:1787906897.569026:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787906897.569036:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000342144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787906897.569073:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906897.569123:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000342144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906897.569131:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787906897.569204:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787906897.569234:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa520afd180 x1874756000342144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906897.569257:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000342144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787906897.571865:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787906898.435805:0:11468:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 04:48:16 (1787906896) === 00010000:00010000:3.0:1787906898.603780:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906898.790991:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906898.791073:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906898.791208:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971990528 00000100:00100000:3.0:1787906898.791220:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971990528 00000100:00100000:3.0:1787906898.791309:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:3.0:1787906898.791326:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755971990528:12345-192.168.204.20@tcp:41:mkdir.0 00000004:00000024:3.0:1787906898.791417:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787906898.791524:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755971990528:12345-192.168.204.20@tcp:41:mkdir.0 Request processed in 204us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906898.791533:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:3.0:1787906898.791565:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971990656 00000100:00100000:3.0:1787906898.791568:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971990656 00000100:00100000:3.0:1787906898.791595:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1787906898.791602:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:9693:x1874755971990656:12345-192.168.204.20@tcp:700:mkdir.0 00000100:00100000:3.0:1787906898.791637:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:9693:x1874755971990656:12345-192.168.204.20@tcp:700:mkdir.0 Request processed in 36us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906898.791644:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00080000:1.0:1787906898.794019:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906898.824309:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906898.824693:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971990912 00000100:00100000:2.0:1787906898.824706:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971990912 00000100:00100000:2.0:1787906898.824776:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:2.0:1787906898.824788:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:9693:x1874755971990912:12345-192.168.204.20@tcp:36:mkdir.0 00010000:00010000:2.0:1787906898.824887:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906898.824970:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad250 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef553 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.825002:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:2.0:1787906898.825014:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787906898.825665:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad36f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.825679:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad36f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.825691:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad36f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.825721:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad376 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.825730:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad376 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.826352:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad376 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906898.829115:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787906898.829134:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad36f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.829145:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad36f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.829154:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad36f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.829160:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906898.829165:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad36f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.829173:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad36f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.829193:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:2.0:1787906898.829195:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906898.829200:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad36f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.829205:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad36f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787906898.829226:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054767411 reply state 000000000b92360d transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad376 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906898.829249:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787906898.829410:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:9693:x1874755971990912:12345-192.168.204.20@tcp:36:mkdir.0 Request processed in 4619us (5107us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787906898.829420:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00010000:00010000:3.0:1787906898.836155:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad376 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906898.836180:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad376 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906898.836189:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad376 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906898.836195:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906898.836201:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad376 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906898.836208:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad376 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906898.836232:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8aa5069aa600) 00010000:00010000:3.0:1787906898.836256:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906898.836265:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad376 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906898.836272:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad376 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906898.857640:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906898.858136:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971991040 00000100:00100000:3.0:1787906898.858156:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971991040 00000100:00100000:3.0:1787906898.858320:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:3.0:1787906898.858337:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:9697:x1874755971991040:12345-192.168.204.20@tcp:101:chmod.0 00010000:00010000:3.0:1787906898.858736:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906898.858883:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad37d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef5d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906898.859119:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad384 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906898.859140:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad384 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906898.859155:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad384 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906898.859314:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787906898.859319:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906898.859753:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad384 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906898.859966:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad37d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5d8 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906898.860173:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad384 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5d8 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906898.860186:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:3.0:1787906898.860189:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787906898.860193:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030800, rc 0) 00000100:00100000:3.0:1787906898.861681:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:9697:x1874755971991040:12345-192.168.204.20@tcp:101:chmod.0 Request processed in 3334us (4046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906898.861695:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:0.0:1787906898.879454:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906898.879565:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971991296 00000100:00100000:1.0:1787906898.879582:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971991296 00000100:00100000:1.0:1787906898.879771:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:1.0:1787906898.879787:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+7:9697:x1874755971991296:12345-192.168.204.20@tcp:36:chmod.0 00010000:00010000:1.0:1787906898.879914:0:10853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906898.879957:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad384 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5d8 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906898.879986:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:1.0:1787906898.880001:0:10853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787906898.881216:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad38b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906898.881238:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad38b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906898.881250:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad38b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787906898.881736:0:10853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000301281fb reply state 000000005c33ebd6 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad38b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906898.881748:0:10853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787906898.881763:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787906898.881950:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+8:9697:x1874755971991296:12345-192.168.204.20@tcp:36:chmod.0 Request processed in 2162us (2511us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787906898.881961:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00010000:00010000:2.0:1787906898.891221:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad38b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.891250:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad38b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.891258:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad38b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.891266:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906898.891273:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad38b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.891281:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad38b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.891305:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa518965500) 00010000:00010000:2.0:1787906898.891309:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787906898.891316:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad38b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.891323:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad38b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906898.923572:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906898.923693:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971991424 00000100:00100000:2.0:1787906898.923708:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971991424 00000100:00100000:2.0:1787906898.923803:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:2.0:1787906898.923873:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+7:9698:x1874755971991424:12345-192.168.204.20@tcp:101:chown.0 00010000:00010000:2.0:1787906898.923917:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906898.923951:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad392 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef5df expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.924058:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad399 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.924075:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.924088:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906898.924174:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787906898.924180:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906898.924238:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.924272:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad392 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5df expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.924292:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad399 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5df expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.924301:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:2.0:1787906898.924305:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787906898.924308:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97a00, rc 0) 00000100:00100000:2.0:1787906898.924397:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+8:9698:x1874755971991424:12345-192.168.204.20@tcp:101:chown.0 Request processed in 584us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906898.924414:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:3.0:1787906898.927261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906898.927745:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971991552 00000100:00100000:2.0:1787906898.927764:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971991552 00000100:00100000:2.0:1787906898.928160:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:2.0:1787906898.928176:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+8:9698:x1874755971991552:12345-192.168.204.20@tcp:101:chown.0 00010000:00010000:2.0:1787906898.928207:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906898.928239:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96600/0x72bb6cf063cad3a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef5e6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928344:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928362:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928387:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928407:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad3ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928414:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad3ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928421:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad3ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928559:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad3b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928594:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928602:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906898.928670:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787906898.928675:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906898.928709:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928725:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928731:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928739:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928746:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96c00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906898.928751:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928760:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928776:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:2.0:1787906898.928781:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906898.928786:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928804:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928839:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad3ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928846:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad3ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928852:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad3ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928858:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906898.928861:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad3ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928868:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad3ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928876:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8aa5069aa200) 00010000:00010000:2.0:1787906898.928879:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906898.928882:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad3ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928896:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad3ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.928986:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96600/0x72bb6cf063cad3a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5e6 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.929013:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5e6 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.929028:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906898.929031:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787906898.929034:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97600, rc 0) 00000100:00100000:2.0:1787906898.929125:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+9:9698:x1874755971991552:12345-192.168.204.20@tcp:101:chown.0 Request processed in 953us (1879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906898.929134:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:3.0:1787906898.950228:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906898.950489:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971991808 00000100:00100000:2.0:1787906898.950503:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971991808 00000100:00100000:2.0:1787906898.950586:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:2.0:1787906898.950601:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+9:9698:x1874755971991808:12345-192.168.204.20@tcp:36:chown.0 00010000:00010000:2.0:1787906898.950703:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906898.950741:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad3b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5e6 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.950769:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906898.950783:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787906898.950894:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96600/0x72bb6cf063cad3bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.950911:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96600/0x72bb6cf063cad3bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906898.950921:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96600/0x72bb6cf063cad3bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906898.961447:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906898.961509:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906898.961574:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971991936 00000100:00100000:2.0:1787906898.961589:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971991936 00000100:00100000:2.0:1787906898.961659:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 255 00000100:00100000:2.0:1787906898.961672:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:2344:x1874755971991936:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906898.961768:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:2344:x1874755971991936:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 98us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906898.961777:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 255 00000100:00100000:0.0:1787906898.962194:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971992064 00000100:00100000:0.0:1787906898.962200:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971992064 00000100:00100000:0.0:1787906898.962260:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:0.0:1787906898.962268:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2344:x1874755971992064:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906898.962314:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2344:x1874755971992064:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 47us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906898.962321:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00080000:2.0:1787906898.962573:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1787906899.052045:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d467c01b reply state 00000000727074f1 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96600/0x72bb6cf063cad3bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906899.052069:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787906899.052268:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787906899.052431:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+10:9698:x1874755971991808:12345-192.168.204.20@tcp:36:chown.0 Request processed in 101826us (102214us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787906899.052442:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000001:00080000:3.0:1787906899.053644:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1787906899.053688:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1787906899.053761:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96600/0x72bb6cf063cad3bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.053774:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96600/0x72bb6cf063cad3bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.053784:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96600/0x72bb6cf063cad3bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.053791:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906899.053796:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96600/0x72bb6cf063cad3bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.053853:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96600/0x72bb6cf063cad3bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.053879:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa5069aa200) 00010000:00010000:0.0:1787906899.054923:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787906899.054938:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96600/0x72bb6cf063cad3bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.054949:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96600/0x72bb6cf063cad3bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906899.080534:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906899.081113:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971992192 00000100:00100000:2.0:1787906899.081129:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971992192 00000100:00100000:2.0:1787906899.081224:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:2.0:1787906899.081238:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:9699:x1874755971992192:12345-192.168.204.20@tcp:101:touch.500 00010000:00010000:2.0:1787906899.081274:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906899.081303:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad3c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef5ed expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787906899.085126:0:5830:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3738us 00010000:00010000:3.0:1787906899.113610:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad3ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.113647:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad3ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.113663:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad3ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.113684:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad3d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.113692:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.113699:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115136:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115152:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115171:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906899.115265:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787906899.115271:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906899.115402:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115422:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad3ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115430:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad3ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115439:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad3ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115445:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906899.115450:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad3ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115459:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad3ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115474:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:2.0:1787906899.115477:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906899.115483:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad3ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115488:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad3ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115515:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115520:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad3d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115525:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115530:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906899.115533:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115539:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad3d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115548:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8aa5069ca400) 00010000:00010000:2.0:1787906899.115550:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906899.115553:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad3d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115559:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad3d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115612:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad3c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5ed expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115628:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5ed expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.115646:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa5069aa500) 00010000:00010000:2.0:1787906899.115648:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787906899.115650:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96c00, rc 0) 00000100:00100000:2.0:1787906899.115762:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:9699:x1874755971992192:12345-192.168.204.20@tcp:101:touch.500 Request processed in 34524us (35242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906899.115774:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:0.0:1787906899.125419:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906899.125554:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971992448 00000100:00100000:1.0:1787906899.125571:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971992448 00000100:00100000:1.0:1787906899.125655:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:1.0:1787906899.125670:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+7:9699:x1874755971992448:12345-192.168.204.20@tcp:101:touch.500 00010000:00010000:1.0:1787906899.125713:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906899.125748:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad3df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef5f4 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906899.126720:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad3e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906899.126743:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906899.126759:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.132392:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad3ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.132433:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad3ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.132452:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad3ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787906899.134597:0:10853:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787906899.135226:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad3f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.135248:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.135262:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.135328:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.135337:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad3e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.135346:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad3e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.135353:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211e00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906899.135360:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad3e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.135381:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad3e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.135398:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa5069aa500) 00010000:00010000:0.0:1787906899.135403:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906899.135409:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad3e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.135416:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad3e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787906899.135434:0:10853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2ec4e7e reply state 000000005a2339af transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad3ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906899.135446:0:10853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787906899.135492:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad3df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5f4 expref: 10 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.135524:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5f4 expref: 9 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.135532:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa510860000) 00010000:00010000:0.0:1787906899.135535:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906899.135538:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8e000, rc 0) 00000100:00100000:0.0:1787906899.135659:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+10:9699:x1874755971992448:12345-192.168.204.20@tcp:101:touch.500 Request processed in 9992us (10261us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787906899.135670:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00010000:00010000:0.0:1787906899.139407:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad3ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.139438:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad3ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.139447:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad3ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.139455:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906899.139463:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad3ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.139472:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad3ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.139496:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x928f5058 (ffff8aa510860600) 00010000:00010000:0.0:1787906899.139499:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906899.139506:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad3ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.139535:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad3ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906899.142649:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906899.143212:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971992704 00000100:00100000:2.0:1787906899.143228:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971992704 00000100:00100000:2.0:1787906899.143313:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:2.0:1787906899.143328:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+9:9699:x1874755971992704:12345-192.168.204.20@tcp:36:touch.500 00010000:00010000:2.0:1787906899.143450:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906899.143487:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad3f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5f4 expref: 9 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.143511:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906899.143524:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787906899.143581:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad402 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.143600:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad402 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.143612:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad402 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787906899.143871:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ec82b7a reply state 0000000092601c37 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad402 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906899.144532:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787906899.144716:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+10:9699:x1874755971992704:12345-192.168.204.20@tcp:36:touch.500 Request processed in 1388us (2078us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787906899.144726:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00010000:00010000:3.0:1787906899.147494:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad402 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.147516:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad402 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.147525:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad402 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.147531:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906899.147537:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad402 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.147546:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad402 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.147571:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:3.0:1787906899.147574:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906899.147581:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad402 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.147588:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad402 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906899.149276:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906899.149637:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971992832 00000100:00100000:2.0:1787906899.149652:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971992832 00000100:00100000:2.0:1787906899.149723:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:2.0:1787906899.149735:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+9:9699:x1874755971992832:12345-192.168.204.20@tcp:101:touch.500 00010000:00010000:2.0:1787906899.149772:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906899.149803:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad409 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef5fb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.149929:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad409 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5fb expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.149945:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad409 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5fb expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.149966:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa5069aae00) 00010000:00010000:2.0:1787906899.149969:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787906899.149974:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97400, rc 0) 00000100:00100000:2.0:1787906899.150061:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+10:9699:x1874755971992832:12345-192.168.204.20@tcp:101:touch.500 Request processed in 329us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906899.150069:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1787906899.161147:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906899.161381:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971992960 00000100:00100000:0.0:1787906899.161396:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971992960 00000100:00100000:0.0:1787906899.161459:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:0.0:1787906899.161471:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2342:x1874755971992960:12345-192.168.204.20@tcp:8:touch.500 00010000:00080000:0.0:1787906899.161516:0:8459:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp t0 exp 0000000000000000 cur 337 last 0 00000020:00000080:0.0:1787906899.161561:0:8459:0:(genops.c:1385:class_connect()) connect: client 419aebcc-abec-417c-9cd3-22c347ab3c27, cookie 0x72bb6cf063cad410 00002000:00100000:0.0:1787906899.161576:0:8459:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 419aebcc-abec-417c-9cd3-22c347ab3c27/ffff8aa534c98800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787906899.161606:0:8459:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787906899.161948:0:8459:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787906899.162008:0:8459:0:(import.c:65:import_set_state_nolock()) ffff8aa534c99800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787906899.162117:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2342:x1874755971992960:12345-192.168.204.20@tcp:8:touch.500 Request processed in 645us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906899.162127:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:1.0:1787906899.169954:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906899.170155:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971993088 00000100:00100000:2.0:1787906899.170169:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971993088 00000100:00100000:2.0:1787906899.170293:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1787906899.170308:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:0:x1874755971993088:12345-192.168.204.20@tcp:2:touch.500 00000100:00080000:1.0:1787906899.171393:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1787906899.263749:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 419aebcc-abec-417c-9cd3-22c347ab3c27 00000001:00080000:1.0:1787906899.263792:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1787906899.273418:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+5:0:x1874755971993088:12345-192.168.204.20@tcp:2:touch.500 Request processed in 103094us (103459us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787906899.273436:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:1.0:1787906899.276545:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906899.277492:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971993344 00000100:00100000:0.0:1787906899.277511:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971993344 00000100:00100000:0.0:1787906899.277647:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:0.0:1787906899.277661:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+10:9699:x1874755971993344:12345-192.168.204.20@tcp:35:touch.500 00000100:00100000:0.0:1787906899.278230:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+11:9699:x1874755971993344:12345-192.168.204.20@tcp:35:touch.500 Request processed in 571us (1699us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787906899.278241:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:3.0:1787906899.315270:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906899.315560:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971993472 00000100:00100000:1.0:1787906899.315574:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971993472 00000100:00100000:1.0:1787906899.315647:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:1.0:1787906899.315660:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+11:9700:x1874755971993472:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:1.0:1787906899.315697:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906899.315727:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211800/0x72bb6cf063cad417 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef602 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906899.315908:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211c00/0x72bb6cf063cad41e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906899.315926:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211c00/0x72bb6cf063cad41e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906899.315940:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211c00/0x72bb6cf063cad41e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906899.316023:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787906899.316028:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787906899.316082:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211c00/0x72bb6cf063cad41e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906899.316115:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211800/0x72bb6cf063cad417 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef602 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906899.316137:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211c00/0x72bb6cf063cad41e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef602 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906899.316147:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa5069aa500) 00010000:00010000:1.0:1787906899.316151:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787906899.316156:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211c00, rc 0) 00000100:00100000:1.0:1787906899.316250:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+12:9700:x1874755971993472:12345-192.168.204.20@tcp:101:rm.0 Request processed in 592us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906899.316260:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:1.0:1787906899.326405:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906899.326545:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971993728 00000100:00100000:2.0:1787906899.326559:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971993728 00000100:00100000:2.0:1787906899.326637:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:2.0:1787906899.326651:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+12:9700:x1874755971993728:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1787906899.326680:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906899.326707:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96400/0x72bb6cf063cad425 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef609 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906899.326938:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787906899.327199:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96400/0x72bb6cf063cad425 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef609 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.327217:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:2.0:1787906899.327220:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787906899.327226:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96400/0x72bb6cf063cad425 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef609 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.327243:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96400, rc 0) 00000100:00100000:2.0:1787906899.327329:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+13:9700:x1874755971993728:12345-192.168.204.20@tcp:101:rm.0 Request processed in 682us (952us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787906899.327338:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:3.0:1787906899.353549:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906899.357161:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971993856 00000100:00100000:2.0:1787906899.357185:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971993856 00000100:00100000:2.0:1787906899.357294:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:2.0:1787906899.357309:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+13:9700:x1874755971993856:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1787906899.364756:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+13:9700:x1874755971993856:12345-192.168.204.20@tcp:37:rm.0 Request processed in 7434us (11209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906899.368314:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:1.0:1787906899.378587:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906899.379189:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971994112 00000100:00100000:0.0:1787906899.379205:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971994112 00000100:00100000:0.0:1787906899.379290:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:0.0:1787906899.379303:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa529398450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+13:9700:x1874755971994112:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:0.0:1787906899.382230:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa529398450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+14:9700:x1874755971994112:12345-192.168.204.20@tcp:35:rm.0 Request processed in 2912us (3645us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787906899.382248:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:3.0:1787906899.393770:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906899.394451:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971994368 00000100:00100000:1.0:1787906899.394469:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971994368 00000100:00100000:1.0:1787906899.394563:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:1.0:1787906899.394577:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+14:9700:x1874755971994368:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:1.0:1787906899.394612:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906899.394644:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef610 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906899.394865:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad43a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906899.395138:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad43a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906899.395155:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad43a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906899.395175:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787906899.395384:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef610 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906899.395410:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad43a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef610 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906899.395420:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa5069aa500) 00010000:00010000:1.0:1787906899.395423:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787906899.395428:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211e00, rc 0) 00000100:00100000:1.0:1787906899.398685:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+16:9700:x1874755971994368:12345-192.168.204.20@tcp:101:rm.0 Request processed in 4089us (4911us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787906899.398729:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:3.0:1787906899.408197:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906899.408548:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971994496 00000100:00100000:2.0:1787906899.408562:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971994496 00000100:00100000:2.0:1787906899.408642:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:2.0:1787906899.408654:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+16:9700:x1874755971994496:12345-192.168.204.20@tcp:41:rm.0 00000004:00000024:2.0:1787906899.408739:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787906899.409160:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+16:9700:x1874755971994496:12345-192.168.204.20@tcp:41:rm.0 Request processed in 224us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906899.409170:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:3.0:1787906899.416070:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906899.416349:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971994624 00000100:00100000:2.0:1787906899.416376:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971994624 00000100:00100000:2.0:1787906899.416461:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:2.0:1787906899.416484:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+16:9700:x1874755971994624:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1787906899.416511:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906899.416540:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96400/0x72bb6cf063cad448 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef617 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.416632:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96800/0x72bb6cf063cad44f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.416651:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96800/0x72bb6cf063cad44f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.416664:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96800/0x72bb6cf063cad44f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.416698:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad456 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.416706:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.416714:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417004:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad45d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417014:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad45d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417021:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad45d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906899.417055:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787906899.417061:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906899.417088:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad45d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417103:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad45d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417113:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96800/0x72bb6cf063cad44f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417121:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96800/0x72bb6cf063cad44f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417140:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96800/0x72bb6cf063cad44f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417148:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906899.417153:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96800/0x72bb6cf063cad44f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417161:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96800/0x72bb6cf063cad44f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417176:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa5069aa500) 00010000:00010000:2.0:1787906899.417180:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906899.417185:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96800/0x72bb6cf063cad44f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417191:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96800/0x72bb6cf063cad44f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417207:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417213:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad456 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417219:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417226:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906899.417229:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417246:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad456 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417255:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x928f5058 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906899.417258:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906899.417261:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad456 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417268:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97200/0x72bb6cf063cad456 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417309:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96400/0x72bb6cf063cad448 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef617 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417326:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad45d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef617 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.417334:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa5069aae00) 00010000:00010000:2.0:1787906899.417336:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787906899.417338:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96000, rc 0) 00000100:00100000:2.0:1787906899.417437:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+17:9700:x1874755971994624:12345-192.168.204.20@tcp:101:rm.0 Request processed in 964us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906899.417445:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:1.0:1787906899.423394:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906899.423755:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971994880 00000100:00100000:0.0:1787906899.423772:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971994880 00000100:00100000:0.0:1787906899.423923:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:0.0:1787906899.423938:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+17:9700:x1874755971994880:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:0.0:1787906899.424289:0:10853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787906899.424338:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad45d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef617 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.424384:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad409 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5fb expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.424401:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa5069aae00) 00010000:00010000:0.0:1787906899.424424:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211c00/0x72bb6cf063cad41e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef602 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.424434:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa5069aa500) 00010000:00010000:0.0:1787906899.424461:0:10853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787906899.424629:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad464 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.424648:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad464 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.424661:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad464 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.424679:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad46b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.424686:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad46b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.424692:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad46b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.427698:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad472 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.427728:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad472 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.427744:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad472 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787906899.430704:0:10853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787906899.430727:0:10853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337702913171ns, next at 338702908643ns, rc = 0 00010000:00010000:0.0:1787906899.431628:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad479 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431669:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431682:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431692:0:10853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad479 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431699:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad479 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431706:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431775:0:10853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787906899.431841:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad472 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431848:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad472 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431855:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad472 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431860:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906899.431866:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad472 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431883:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad472 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431913:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa510860500) 00010000:00010000:0.0:1787906899.431924:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787906899.431931:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad472 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431937:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad472 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431968:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad464 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431974:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad464 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431980:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad464 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.431985:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906899.431988:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad464 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.432006:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad464 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.432015:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa5069aa500) 00010000:00010000:0.0:1787906899.432018:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906899.432021:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad464 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.432026:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad464 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787906899.432051:0:10853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008737a347 reply state 00000000e1ff6c7b transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad46b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906899.432063:0:10853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787906899.432221:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+16:9700:x1874755971994880:12345-192.168.204.20@tcp:36:rm.0 Request processed in 8280us (8840us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787906899.432232:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00010000:00010000:0.0:1787906899.437096:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad46b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.437122:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad46b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.437131:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad46b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.437138:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906899.437144:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad46b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.437154:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad46b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.437178:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x928f5058 (ffff8aa510860600) 00010000:00010000:0.0:1787906899.437181:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906899.437187:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad46b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.437193:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad46b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.439211:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787906899.439228:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad479 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.439240:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e000 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787906899.439264:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad479 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.439274:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.439294:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa510860500) 00010000:00010000:2.0:1787906899.439297:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787906899.439302:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad479 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.439308:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad479 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906899.439335:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906899.439337:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906899.439340:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906899.440850:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906899.441072:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971995136 00000100:00100000:2.0:1787906899.441086:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971995136 00000100:00100000:2.0:1787906899.441157:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:2.0:1787906899.441170:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+15:9700:x1874755971995136:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1787906899.442121:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+16:9700:x1874755971995136:12345-192.168.204.20@tcp:35:rm.0 Request processed in 947us (1312us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787906899.442133:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:3.0:1787906899.446372:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906899.446458:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971995392 00000100:00100000:0.0:1787906899.446472:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971995392 00000100:00100000:0.0:1787906899.446549:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:0.0:1787906899.446562:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+16:9700:x1874755971995392:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:0.0:1787906899.446664:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787906899.446708:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad43a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef610 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.446739:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cad3d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5ed expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.446755:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa5069aa500) 00010000:00010000:0.0:1787906899.446777:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad399 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5df expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.446787:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:0.0:1787906899.446794:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787906899.446870:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad480 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.446904:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad480 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.446917:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad480 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.446933:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad487 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.446966:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad487 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.446973:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad487 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.447417:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fe00/0x72bb6cf063cad48e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.447427:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fe00/0x72bb6cf063cad48e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.447436:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fe00/0x72bb6cf063cad48e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906899.448254:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787906899.448278:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fe00/0x72bb6cf063cad48e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.448288:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fe00/0x72bb6cf063cad48e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.448297:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fe00/0x72bb6cf063cad48e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.448304:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8fe00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906899.448310:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fe00/0x72bb6cf063cad48e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.448319:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fe00/0x72bb6cf063cad48e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.448346:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa510860200) 00010000:00010000:0.0:1787906899.448350:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787906899.448354:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fe00/0x72bb6cf063cad48e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.448376:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fe00/0x72bb6cf063cad48e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.448404:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad480 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.448411:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad480 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.448418:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad480 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.448424:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906899.448427:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad480 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.448434:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad480 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.448442:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa510860a00) 00010000:00010000:0.0:1787906899.448445:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906899.448448:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad480 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.448454:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad480 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787906899.448479:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003757b3fe reply state 000000001a1bc80f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad487 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906899.448490:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787906899.450502:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+15:9700:x1874755971995392:12345-192.168.204.20@tcp:36:rm.0 Request processed in 3926us (4142us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787906899.450517:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00010000:00010000:3.0:1787906899.453149:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad487 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.453175:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad487 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.453185:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad487 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.453192:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906899.453200:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad487 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.453209:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad487 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.453236:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8aa510860c00) 00010000:00010000:3.0:1787906899.453240:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906899.453245:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad487 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906899.453251:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad487 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906899.618145:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906899.619008:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000342656:0@lo:400:kworker.0 00000100:00100000:1.0:1787906899.619113:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906899.619211:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787906899.619218:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000342528:0@lo:400:kworker.0 00000100:00100000:1.0:1787906899.619248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906899.619286:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000342656 00000100:00100000:1.0:1787906899.619296:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000342656 00000100:00100000:1.0:1787906899.619385:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787906899.619397:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000342656:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787906899.619673:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787906899.619718:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe2680 x1874756000342656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906899.619736:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000342656:0@lo:400:kworker.0 00000100:00100000:2.0:1787906899.619916:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000342272:0@lo:400:kworker.0 00000100:00100000:2.0:1787906899.619967:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906899.620017:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000342784:0@lo:400:kworker.0 00000100:00100000:2.0:1787906899.620046:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906899.620072:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787906899.620117:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000342400:0@lo:400:kworker.0 00000100:00100000:2.0:1787906899.620144:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906899.620166:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000342912:0@lo:400:kworker.0 00000100:00100000:2.0:1787906899.620192:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906899.620229:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000342912 00000100:00100000:2.0:1787906899.620235:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000342912 00000100:00100000:2.0:1787906899.620280:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787906899.620288:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000342912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906899.620333:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000342912:12345-0@lo:400:kworker.0 Request processed in 46us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906899.620340:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1787906899.620393:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe0700 x1874756000342912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906899.620403:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000342912:0@lo:400:kworker.0 00000100:00080000:2.0:1787906899.620421:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787906899.620433:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000342528 00000100:00100000:2.0:1787906899.620437:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000342528 00000100:00100000:2.0:1787906899.620467:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000342784 00000100:00100000:2.0:1787906899.620481:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000342784 00000100:00100000:2.0:1787906899.620498:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000342400 00000100:00100000:2.0:1787906899.620501:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000342400 00000100:00100000:2.0:1787906899.620515:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787906899.620522:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000342528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906899.620563:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000342528:12345-0@lo:400:kworker.0 Request processed in 41us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906899.620569:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787906899.620582:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787906899.620597:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000342784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906899.620635:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000342784:12345-0@lo:400:kworker.0 Request processed in 39us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906899.620641:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787906899.620653:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787906899.620659:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000342400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906899.620688:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000342400:12345-0@lo:400:kworker.0 Request processed in 28us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906899.620694:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1787906899.620709:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906899.620728:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000342400:0@lo:400:kworker.0 00000100:00100000:2.0:1787906899.620736:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000342784:0@lo:400:kworker.0 00000100:00100000:2.0:1787906899.620766:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000342528:0@lo:400:kworker.0 00000100:00100000:0.0:1787906899.621317:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000342272 00000100:00100000:0.0:1787906899.621324:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000342272 00000100:00100000:0.0:1787906899.621375:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787906899.621384:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000342272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906899.621438:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000342272:12345-0@lo:400:kworker.0 Request processed in 56us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906899.621445:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787906899.621501:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000342272:0@lo:400:kworker.0 00000100:00100000:1.0:1787906899.621673:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000342656:12345-0@lo:400:kworker.0 Request processed in 73us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906899.621685:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787906900.130658:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000343040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787906900.130784:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906900.132148:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000343040 00000100:00100000:1.0:1787906900.132165:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000343040 00000100:00100000:1.0:1787906900.132261:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787906900.132273:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000343040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787906900.132306:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906900.132414:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000343040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906900.132422:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787906900.132711:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53b04ad80 x1874756000343040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906900.132741:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000343040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906900.641748:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906901.665453:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906902.688979:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906902.689888:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000343168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787906902.690002:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906902.690037:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000343168 00000100:00100000:1.0:1787906902.690048:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000343168 00000100:00100000:1.0:1787906902.690139:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787906902.690150:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000343168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787906902.690205:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906902.691037:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000343168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 882us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906902.691049:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787906902.691088:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787906902.691730:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa534fe1f80 x1874756000343168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906902.691782:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000343168:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787906903.713394:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906904.077125:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906904.077187:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906904.077360:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906904.077402:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906904.077443:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971995648 00000100:00100000:1.0:1787906904.077455:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971995648 00000100:00100000:1.0:1787906904.077529:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971995904 00000100:00100000:1.0:1787906904.077533:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971995904 00000100:00100000:1.0:1787906904.077564:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:1.0:1787906904.077578:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+14:2345:x1874755971995648:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906904.077696:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+14:2345:x1874755971995648:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 121us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906904.077705:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:1.0:1787906904.077727:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:1.0:1787906904.077734:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755971995904:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906904.077762:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755971995904:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906904.077768:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00080000:1.0:1787906904.077804:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906904.078852:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971995520 00000100:00100000:2.0:1787906904.078863:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971995520 00000100:00100000:2.0:1787906904.078929:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 257 00000100:00100000:2.0:1787906904.078938:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755971995520:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906904.078996:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755971995520:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 60us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906904.079005:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 257 00000100:00100000:0.0:1787906904.084170:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971995776 00000100:00100000:0.0:1787906904.084195:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971995776 00000100:00100000:0.0:1787906904.084396:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:0.0:1787906904.084413:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2345:x1874755971995776:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906904.084543:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2345:x1874755971995776:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 135us (7354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906904.084552:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00080000:2.0:1787906904.085224:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787906904.287570:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1787906904.287610:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787906904.287931:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000343296:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787906904.288041:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906904.288396:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000343296 00000100:00100000:2.0:1787906904.288424:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000343296 00000100:00100000:2.0:1787906904.288500:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787906904.288511:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000343296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787906904.288547:0:6674:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787906904.288596:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a914b52, atime: 0x6a914b52, ctime: 0x6a914b52, blocks: 0x1 00010000:00010000:2.0:1787906904.288605:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cad495 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906904.288625:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1787906904.289015:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787906904.289024:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cad495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906904.289047:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cad495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906904.289060:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cad495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906904.289069:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cad495 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906904.289098:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787906904.289741:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787906904.289752:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cad495 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906904.289762:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96200 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787906904.289768:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cad495 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906904.289778:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cad495 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906904.289838:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cad495 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906904.289846:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cad495 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906904.289871:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906904.289873:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906904.289876:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906904.291370:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874756000343296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2847us (3317us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787906904.291387:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787906904.291439:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787906904.291510:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa534fe6680/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787906904.291519:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000343296:0@lo:6:osp-syn-1-0.0 00000001:02000400:1.0:1787906904.725046:0:11618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1787906904.736545:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906904.736621:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000343424:0@lo:400:kworker.0 00000100:00100000:3.0:1787906904.736724:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906904.736888:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000343424 00000100:00100000:0.0:1787906904.736898:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000343424 00000100:00100000:0.0:1787906904.736963:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787906904.736975:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000343424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906904.737040:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000343424:12345-0@lo:400:kworker.0 Request processed in 66us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906904.737048:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787906904.738868:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000343424:0@lo:400:kworker.0 00000100:00100000:3.0:1787906904.738908:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000343936:0@lo:400:kworker.0 00000100:00100000:1.0:1787906904.738912:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000343808:0@lo:400:kworker.0 00000100:00100000:1.0:1787906904.740494:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906904.740859:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906904.740915:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000343936 00000100:00100000:3.0:1787906904.740927:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000343936 00000100:00100000:3.0:1787906904.741005:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787906904.741018:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000343936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906904.741087:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000343936:12345-0@lo:400:kworker.0 Request processed in 72us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906904.741095:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1787906904.741119:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906904.741160:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000343936:0@lo:400:kworker.0 00000100:00100000:0.0:1787906904.741297:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000343552:0@lo:400:kworker.0 00000100:00100000:0.0:1787906904.741338:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906904.741371:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000344064:0@lo:400:kworker.0 00000100:00100000:0.0:1787906904.741400:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906904.741420:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787906904.741427:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000343680:0@lo:400:kworker.0 00000100:00100000:0.0:1787906904.741448:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906904.741539:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000343552 00000100:00100000:3.0:1787906904.741544:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000343552 00000100:00100000:3.0:1787906904.741574:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000343680 00000100:00100000:3.0:1787906904.741578:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000343680 00000100:00100000:3.0:1787906904.741602:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787906904.741609:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000343552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906904.741645:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000343552:12345-0@lo:400:kworker.0 Request processed in 37us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906904.741651:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787906904.741662:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787906904.741668:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000343680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906904.741695:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000343680:12345-0@lo:400:kworker.0 Request processed in 28us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906904.741701:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787906904.741723:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000343808 00000100:00100000:3.0:1787906904.741727:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000343808 00000100:00100000:3.0:1787906904.741755:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000344064 00000100:00100000:3.0:1787906904.741776:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000344064 00000100:00100000:3.0:1787906904.741802:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787906904.741808:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000343808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906904.742042:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000343808:12345-0@lo:400:kworker.0 Request processed in 234us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906904.742049:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787906904.742062:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787906904.742068:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1874756000344064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906904.742098:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1874756000344064:12345-0@lo:400:kworker.0 Request processed in 31us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906904.742105:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1787906904.742119:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787906904.742122:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906904.742229:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000343680:0@lo:400:kworker.0 00000100:00100000:0.0:1787906904.742253:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000343552:0@lo:400:kworker.0 00000100:00100000:0.0:1787906904.742277:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000344064:0@lo:400:kworker.0 00010000:00080000:3.0:1787906904.745840:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510212a00 x1874756000343808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906904.745866:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000343808:0@lo:400:kworker.0 00000100:00100000:0.0:1787906905.248244:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000344192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787906905.248384:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906905.248572:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000344192 00000100:00100000:2.0:1787906905.248584:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000344192 00000100:00100000:2.0:1787906905.248784:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787906905.248797:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874756000344192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787906905.248878:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906905.248964:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874756000344192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906905.248973:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787906905.249399:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000344192:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906905.760625:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787906905.938131:0:11667:0:(class_obd.c:354:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef1d649d0 20000000:00000080:1.0:1787906905.938154:0:11667:0:(mgs_handler.c:1205:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8aa508a58400 uarg=0000000000000000 20000000:01000000:1.0:1787906905.938200:0:11667:0:(mgs_llog.c:6200:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787906905.938209:0:11667:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787906905.938216:0:11667:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787906905.942609:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787906905.942792:0:11667:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787906905.948770:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787906905.949123:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787906905.949203:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787906905.949221:0:11667:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787906905.949252:0:11667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906905.949273:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa53ac8f400/0x72bb6cf063cad337 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5ca expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906905.949296:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad33e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5d1 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906905.949304:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa500031200/0x72bb6cf063cad34c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad345 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906905.949312:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cad35a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad353 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906905.949319:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa508210600/0x72bb6cf063cad368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad361 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906905.949328:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906905.949374:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa508210600/0x72bb6cf063cad368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad361 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906905.949391:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa508210600/0x72bb6cf063cad368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad361 expref: 18 pid: 5825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906905.949407:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874756000344320:0@lo:104: 00000100:00100000:3.0:1787906905.949478:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787906905.949534:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cad35a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad353 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906905.949543:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cad35a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad353 expref: 18 pid: 5825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906905.949562:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874756000344448:0@lo:104: 00000100:00100000:3.0:1787906905.949586:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787906905.949624:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa500031200/0x72bb6cf063cad34c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cad345 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906905.949632:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa500031200/0x72bb6cf063cad34c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cad345 expref: 18 pid: 5824 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906905.949640:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874756000344576:0@lo:104: 00000100:00100000:3.0:1787906905.949660:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787906905.949684:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad33e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5d1 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906905.949694:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad33e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5d1 expref: 12 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906905.949703:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874756000344704:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906905.949763:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa53ac8f400/0x72bb6cf063cad337 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5ca expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906905.949772:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa53ac8f400/0x72bb6cf063cad337 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5ca expref: 12 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906905.949780:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f77480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874756000344832:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906905.949803:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787906905.950167:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787906905.950181:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000344320 00000100:00100000:0.0:1787906905.950201:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000344320 00000100:00100000:0.0:1787906905.950251:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000344448 00000100:00100000:0.0:1787906905.950254:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000344448 00000100:00100000:0.0:1787906905.950266:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000344576 00000100:00100000:0.0:1787906905.950269:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000344576 00000100:00100000:0.0:1787906905.950284:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787906905.950294:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+5:11667:x1874756000344320:12345-0@lo:104: 00010000:00010000:0.0:1787906905.950308:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad368 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950365:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787906905.950371:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+5:11667:x1874756000344320:12345-0@lo:104: Request processed in 79us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906905.950377:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787906905.950394:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787906905.950400:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:11667:x1874756000344448:12345-0@lo:104: 00010000:00010000:0.0:1787906905.950407:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad35a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950471:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787906905.950477:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+4:11667:x1874756000344448:12345-0@lo:104: Request processed in 78us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906905.950482:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787906905.950494:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787906905.950500:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52ee09450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:11667:x1874756000344576:12345-0@lo:104: 00010000:00010000:0.0:1787906905.950508:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad34c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950541:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787906905.950547:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52ee09450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+3:11667:x1874756000344576:12345-0@lo:104: Request processed in 48us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906905.950552:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787906905.950600:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787906905.950607:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad368 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950614:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210a00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:0.0:1787906905.950619:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad368 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950629:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad368 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787906905.950636:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad368 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906905.950641:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787906905.950681:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad368 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950687:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787906905.950715:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad368 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950721:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa508210a00/0x72bb6cf063cad361 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad368 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950736:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787906905.950739:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad35a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950744:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96e00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:0.0:1787906905.950747:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad35a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950754:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad35a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787906905.950759:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad35a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906905.950764:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787906905.950775:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad35a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950780:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787906905.950786:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad35a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950803:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa541c96e00/0x72bb6cf063cad353 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad35a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950836:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787906905.950840:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cad34c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950846:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97800 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:0.0:1787906905.950849:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cad34c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.950856:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cad34c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787906905.950862:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cad34c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906905.951040:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787906905.951057:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad34c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.951064:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787906905.951083:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad34c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.951091:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa541c97800/0x72bb6cf063cad345 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cad34c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.951106:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906905.951113:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906905.951115:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906905.951122:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906905.951128:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906905.951151:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000344960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787906905.951187:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906905.951293:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787906905.951300:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000345088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787906905.951324:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906905.951355:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000345216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787906905.951381:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906905.951414:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000344960 00000100:00100000:0.0:1787906905.951421:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000344960 00010000:00010000:0.0:1787906905.951442:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa508210600/0x72bb6cf063cad368 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad361 expref: 19 pid: 5825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906905.951464:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000345088 00000100:00100000:0.0:1787906905.951467:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000345088 00010000:00010000:0.0:1787906905.951476:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cad35a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad353 expref: 20 pid: 5825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906905.951487:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000345216 00000100:00100000:0.0:1787906905.951489:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000345216 00010000:00010000:0.0:1787906905.951498:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa500031200/0x72bb6cf063cad34c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad345 expref: 21 pid: 5824 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906905.951511:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787906905.951518:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+21:3303:x1874756000344960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787906905.951528:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906905.951540:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa508210600/0x72bb6cf063cad368 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad361 expref: 21 pid: 5825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.951551:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa508210600/0x72bb6cf063cad368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad361 expref: 21 pid: 5825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.951568:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906905.951601:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+21:3303:x1874756000344960:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906905.951608:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787906905.951624:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787906905.951630:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+20:3303:x1874756000345088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787906905.951637:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906905.951640:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cad35a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad353 expref: 20 pid: 5825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.951647:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cad35a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad353 expref: 20 pid: 5825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.951656:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906905.951675:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+20:3303:x1874756000345088:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906905.951680:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787906905.951692:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787906905.951697:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510225050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3301:x1874756000345216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787906905.951704:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906905.951709:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa500031200/0x72bb6cf063cad34c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cad345 expref: 19 pid: 5824 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.951728:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa500031200/0x72bb6cf063cad34c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cad345 expref: 19 pid: 5824 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.951738:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906905.951764:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510225050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3301:x1874756000345216:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906905.951770:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787906905.951856:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000345216:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787906905.952439:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa508210600/0x72bb6cf063cad368 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad361 expref: 18 pid: 5825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906905.952464:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874756000344320:0@lo:104: 00010000:00010000:3.0:1787906905.952479:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cad35a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad353 expref: 17 pid: 5825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906905.952487:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874756000344448:0@lo:104: 00010000:00010000:3.0:1787906905.952498:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa500031200/0x72bb6cf063cad34c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cad345 expref: 16 pid: 5824 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906905.952505:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874756000344576:0@lo:104: 00000100:00100000:0.0:1787906905.952574:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000345088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787906905.952582:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000344960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787906905.957699:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906905.957758:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906905.957860:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971996032 00000100:00100000:0.0:1787906905.957871:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971996032 00000100:00100000:3.0:1787906905.958006:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874756000344704:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906905.958022:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f77480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874756000344832:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906905.958072:0:11667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958109:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad33e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5d1 expref: 13 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906905.958147:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971996160 00000100:00100000:0.0:1787906905.958150:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971996160 00010000:00010000:0.0:1787906905.958162:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa53ac8f400/0x72bb6cf063cad337 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5ca expref: 14 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906905.958192:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:0.0:1787906905.958202:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9eec00eb-d19d-4892-ad44-299469e66291+14:2345:x1874755971996032:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906905.958217:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906905.958223:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad33e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5d1 expref: 14 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958268:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad33e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5d1 expref: 14 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958287:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cad33e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5d1 expref: 14 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958307:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906905.958373:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755971996032:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 172us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906905.958380:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:0.0:1787906905.958400:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:0.0:1787906905.958406:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9eec00eb-d19d-4892-ad44-299469e66291+12:2345:x1874755971996160:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906905.958414:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906905.958418:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa53ac8f400/0x72bb6cf063cad337 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5ca expref: 12 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958426:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa53ac8f400/0x72bb6cf063cad337 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5ca expref: 12 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958435:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa53ac8f400/0x72bb6cf063cad337 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef5ca expref: 12 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958446:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958454:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958485:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958493:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958500:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958507:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958524:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031600 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787906905.958529:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958537:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958558:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906905.958571:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906905.958592:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9eec00eb-d19d-4892-ad44-299469e66291+11:2345:x1874755971996160:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 186us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906905.958598:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00010000:00010000:3.0:1787906905.958636:0:11667:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906905.958647:0:11667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906905.958655:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa500031600/0x72bb6cf063cad49c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906906.787548:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906907.338476:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906907.338661:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971996288 00000100:00100000:2.0:1787906907.338676:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971996288 00000100:00100000:2.0:1787906907.339514:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 259 00000100:00100000:2.0:1787906907.339528:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+11:5589:x1874755971996288:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787906907.339549:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906907.339570:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cad4a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef61e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906907.339600:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cad4a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef61e expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906907.339611:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cad4a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef61e expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906907.339621:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96600, rc 0) 00000100:00100000:2.0:1787906907.339857:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+12:5589:x1874755971996288:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 332us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906907.339878:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 259 00000100:00100000:0.0:1787906907.345570:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906907.347634:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971996416 00000100:00100000:2.0:1787906907.347657:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971996416 00000100:00100000:2.0:1787906907.349740:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 260 00000100:00100000:2.0:1787906907.349947:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+12:5589:x1874755971996416:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906907.351502:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+12:5589:x1874755971996416:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 1737us (5934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906907.351516:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 260 00000100:00100000:0.0:1787906907.363283:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906907.363402:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971996544 00000100:00100000:2.0:1787906907.363416:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971996544 00000100:00100000:2.0:1787906907.363558:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 261 00000100:00100000:2.0:1787906907.363570:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+12:5589:x1874755971996544:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906907.364247:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+12:5589:x1874755971996544:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 677us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906907.364257:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 261 00000100:00100000:1.0:1787906907.377497:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906907.378501:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971996672 00000100:00100000:2.0:1787906907.378514:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971996672 00000100:00100000:2.0:1787906907.378569:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 262 00000100:00100000:2.0:1787906907.378580:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+12:9973:x1874755971996672:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787906907.379536:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+12:9973:x1874755971996672:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 953us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906907.379546:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 262 00000100:00100000:0.0:1787906907.397229:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906907.402045:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971996800 00000100:00100000:2.0:1787906907.402063:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971996800 00000100:00100000:2.0:1787906907.402170:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 263 00000100:00100000:2.0:1787906907.402183:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+12:9973:x1874755971996800:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787906907.408976:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+12:9973:x1874755971996800:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 6783us (11745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906907.408990:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 263 00000100:00100000:0.0:1787906907.414532:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906907.415182:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971996928 00000100:00100000:2.0:1787906907.415196:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971996928 00000100:00100000:2.0:1787906907.415279:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 264 00000100:00100000:2.0:1787906907.415292:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+12:5589:x1874755971996928:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787906907.415315:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906907.415336:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad4aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef625 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906907.415371:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad4aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef625 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906907.415384:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad4aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef625 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906907.415534:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96800, rc 0) 00000100:00100000:2.0:1787906907.415607:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:5589:x1874755971996928:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 318us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906907.415614:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 264 00000100:00100000:1.0:1787906907.419164:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906907.419985:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971997056 00000100:00100000:2.0:1787906907.420008:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971997056 00000100:00100000:2.0:1787906907.420084:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 265 00000100:00100000:2.0:1787906907.420095:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:5589:x1874755971997056:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906907.420507:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:5589:x1874755971997056:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 411us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906907.420516:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 265 10000000:01000000:3.0:1787906907.424638:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787906907.424647:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa401350800 from 7 10000000:01000000:3.0:1787906907.424652:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787906907.424729:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906907.424771:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906907.424784:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906907.424845:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000345344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787906907.424921:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906907.424980:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed823c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787906907.426201:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000345344 00000100:00100000:2.0:1787906907.426225:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000345344 00000100:00100000:2.0:1787906907.426306:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787906907.426329:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:5827:x1874756000345344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787906907.426346:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906907.426367:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa541c97200/0x72bb6cf063cad4b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad4b1 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906907.426403:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c97200/0x72bb6cf063cad4b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad4b1 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906907.426417:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa541c97200/0x72bb6cf063cad4b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad4b1 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906907.426426:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97200, rc 0) 00000100:00100000:2.0:1787906907.426499:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000345344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906907.426507:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787906907.427506:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000345344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787906907.427529:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad4b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906907.427539:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad4b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906907.427621:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000345472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787906907.427668:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906907.427731:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787906907.427799:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000345472 00000100:00100000:0.0:1787906907.427807:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000345472 00000100:00100000:0.0:1787906907.427881:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787906907.427890:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000345472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787906907.428230:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000345472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 340us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906907.428239:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787906907.429536:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000345472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787906907.429609:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000345600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787906907.429705:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906907.430698:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787906907.432565:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000345600 00000100:00100000:0.0:1787906907.432579:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000345600 00000100:00100000:0.0:1787906907.432659:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787906907.432670:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000345600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787906907.432955:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000345600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 287us (3250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906907.432963:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787906907.433958:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000345600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787906907.436223:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:11680:1874756000345728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787906907.436354:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906907.436416:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed82cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787906907.436551:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000345728 00000100:00100000:2.0:1787906907.436560:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000345728 00000100:00100000:2.0:1787906907.436621:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787906907.436633:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:11680:x1874756000345728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906907.436963:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:11680:x1874756000345728:12345-0@lo:502:llog_process_th.0 Request processed in 331us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906907.436977:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787906907.441404:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:11680:1874756000345728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787906907.441459:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787906907.441473:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787906907.441475:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787906907.441482:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8aa401350800 00000020:00000080:3.0:1787906907.441485:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787906907.441588:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534f77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:11680:1874756000345856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787906907.441668:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906907.441740:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed82cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787906907.446074:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000345856 00000100:00100000:2.0:1787906907.446090:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000345856 00000100:00100000:2.0:1787906907.446160:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787906907.446172:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:11680:x1874756000345856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906907.446479:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:11680:x1874756000345856:12345-0@lo:502:llog_process_th.0 Request processed in 308us (4809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906907.446487:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787906907.447165:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534f77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:11680:1874756000345856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787906907.447218:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787906907.447228:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787906907.447230:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787906907.447234:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:0.0:1787906907.450231:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906907.450292:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971997184 00000100:00100000:0.0:1787906907.450301:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971997184 00000100:00100000:0.0:1787906907.450351:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 271 00000100:00100000:0.0:1787906907.450361:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:5589:x1874755971997184:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787906907.450589:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:5589:x1874755971997184:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 228us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906907.450597:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 271 00000020:01000000:2.0:1787906907.452567:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787906907.452616:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787906907.452633:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad4b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906907.452649:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad4b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787906907.452661:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787906907.452664:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa510341800 from 7 10000000:01000000:2.0:1787906907.452667:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787906907.452738:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906907.452748:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906907.453076:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906907.453105:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000345984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787906907.453201:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906907.453252:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa516d709c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787906907.458084:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000345984 00000100:00100000:1.0:1787906907.458103:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000345984 00000100:00100000:1.0:1787906907.458170:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787906907.458178:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:5827:x1874756000345984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787906907.458194:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906907.458223:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa508211200/0x72bb6cf063cad4c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad4bf expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906907.458250:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508211200/0x72bb6cf063cad4c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad4bf expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906907.458260:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa508211200/0x72bb6cf063cad4c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad4bf expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906907.458278:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211200, rc 0) 00000100:00100000:1.0:1787906907.458356:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000345984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (5155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906907.458383:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787906907.462237:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000345984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787906907.462292:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad4c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906907.462307:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad4c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906907.462451:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000346112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906907.462540:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906907.462601:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa516d709c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787906907.463392:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000346112 00000100:00100000:1.0:1787906907.463409:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000346112 00000100:00100000:1.0:1787906907.463465:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787906907.463475:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000346112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787906907.464256:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000346112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 780us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906907.464489:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787906907.466931:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000346112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906907.467001:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000346240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787906907.467081:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906907.467123:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa516d709c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787906907.467779:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000346240 00000100:00100000:0.0:1787906907.467789:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000346240 00000100:00100000:0.0:1787906907.467864:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787906907.467875:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000346240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787906907.468098:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000346240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906907.468106:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787906907.468567:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000346240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787906907.475580:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:11683:1874756000346368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787906907.475718:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906907.475794:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa535d91480 going to sleep for 11 seconds 00000100:00100000:0.0:1787906907.475952:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000346368 00000100:00100000:0.0:1787906907.475961:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000346368 00000100:00100000:0.0:1787906907.476012:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787906907.476023:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:11683:x1874756000346368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787906907.476260:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:11683:x1874756000346368:12345-0@lo:502:llog_process_th.0 Request processed in 237us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906907.476268:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787906907.476605:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:11683:1874756000346368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787906907.476635:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787906907.476644:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787906907.476647:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787906907.476655:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8aa510341800 00000020:00000080:1.0:1787906907.476657:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787906907.476765:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:11683:1874756000346496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787906907.476805:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906907.477276:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000346496 00000100:00100000:1.0:1787906907.477282:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000346496 00000100:00100000:1.0:1787906907.477314:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787906907.477322:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:11683:x1874756000346496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787906907.478176:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:11683:x1874756000346496:12345-0@lo:502:llog_process_th.0 Request processed in 851us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906907.478196:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787906907.478258:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa535d91480 going to sleep for 11 seconds 00000100:00100000:1.0:1787906907.479987:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:11683:1874756000346496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787906907.480054:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787906907.480066:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787906907.480069:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787906907.480075:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787906907.481668:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787906907.481729:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787906907.481742:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad4c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906907.482608:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad4c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787906907.482623:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787906907.482626:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa51a4db800 from 7 10000000:01000000:0.0:1787906907.482629:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787906907.484039:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906907.484058:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906907.484073:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906907.484125:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000346624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787906907.484201:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906907.484258:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510cb9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787906907.485563:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000346624 00000100:00100000:1.0:1787906907.485575:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000346624 00000100:00100000:1.0:1787906907.485643:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787906907.485654:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:5827:x1874756000346624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787906907.485670:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906907.485686:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa508211800/0x72bb6cf063cad4d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cad4cd expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906907.485713:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508211800/0x72bb6cf063cad4d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cad4cd expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906907.485724:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa508211800/0x72bb6cf063cad4d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cad4cd expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906907.485734:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211800, rc 0) 00000100:00100000:1.0:1787906907.485801:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000346624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906907.486066:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000346624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787906907.486087:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906907.486096:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906907.486171:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000346752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787906907.487099:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906907.487146:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510cb9840 going to sleep for 11 seconds 00000100:00100000:2.0:1787906907.487430:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000346752 00000100:00100000:2.0:1787906907.487437:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000346752 00000100:00100000:2.0:1787906907.487485:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787906907.487494:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5072b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+20:5827:x1874756000346752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787906907.487829:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5072b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+20:5827:x1874756000346752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906907.487847:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787906907.488090:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000346752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787906907.488136:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000346880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787906907.488183:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906907.488224:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa510cb9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787906907.488580:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787906907.488612:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000346880 00000100:00100000:1.0:1787906907.488619:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000346880 00000100:00100000:1.0:1787906907.488656:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787906907.488672:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000346880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787906907.488881:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:5827:x1874756000346880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906907.488888:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787906907.488909:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17707cff-d1ec-407e-b5de-6f2bf29614ad:5827:1874756000346880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787906907.489663:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906907.490375:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971997312 00000100:00100000:1.0:1787906907.490385:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971997312 00000100:00100000:1.0:1787906907.490440:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 280 00000100:00100000:1.0:1787906907.490449:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:9976:x1874755971997312:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787906907.490652:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9eec00eb-d19d-4892-ad44-299469e66291+13:9976:x1874755971997312:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 204us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906907.490659:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 280 00000100:00100000:1.0:1787906907.496302:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:11684:1874756000347008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787906907.496386:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906907.496438:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa535d91f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787906907.502528:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906907.502575:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000347008 00000100:00100000:1.0:1787906907.502587:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000347008 00000100:00100000:1.0:1787906907.506198:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787906907.506323:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:11684:x1874756000347008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787906907.506388:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971997440 00000100:00100000:0.0:1787906907.506397:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971997440 00000100:00100000:2.0:1787906907.506552:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 282 00000100:00100000:2.0:1787906907.506572:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:9976:x1874755971997440:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787906907.506878:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9eec00eb-d19d-4892-ad44-299469e66291+13:9976:x1874755971997440:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 309us (4361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906907.507233:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:11684:x1874756000347008:12345-0@lo:502:llog_process_th.0 Request processed in 1010us (10846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906907.507292:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:11684:1874756000347008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787906907.507329:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787906907.507339:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787906907.507346:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787906907.507352:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8aa51a4db800 00000020:00000080:0.0:1787906907.507355:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787906907.507678:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:11684:1874756000347136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787906907.507724:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906907.507748:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa51a57fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787906907.511297:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 282 00000100:00100000:1.0:1787906907.511297:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1787906907.511315:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1787906907.511378:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000347136 00000100:00100000:2.0:1787906907.511388:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000347136 00000100:00100000:2.0:1787906907.511421:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787906907.511430:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+20:11684:x1874756000347136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787906907.511720:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+20:11684:x1874756000347136:12345-0@lo:502:llog_process_th.0 Request processed in 291us (3994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906907.511728:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787906907.515670:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17707cff-d1ec-407e-b5de-6f2bf29614ad:11684:1874756000347136:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787906907.515738:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787906907.515756:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787906907.515759:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787906907.515764:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787906907.515884:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787906907.515911:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787906907.515923:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906907.515936:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906907.516161:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000040:00080000:2.0:1787906907.517333:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787906907.808418:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000347264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787906907.808502:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787906907.809914:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906907.810142:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000347264 00000100:00100000:1.0:1787906907.810157:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000347264 00000100:00100000:1.0:1787906907.810296:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787906907.810309:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000347264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787906907.810363:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906907.810459:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000347264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906907.810466:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1787906907.810645:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510213800 x1874756000347264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906907.810673:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000347264:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787906907.811278:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787906908.576513:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787906908.832198:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906909.194185:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906909.194234:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906909.194266:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906909.194355:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971997696 00000100:00100000:3.0:1787906909.194365:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971997696 00000100:00100000:3.0:1787906909.194431:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971997952 00000100:00100000:3.0:1787906909.194449:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971997952 00000100:00100000:3.0:1787906909.194476:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:3.0:1787906909.194486:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755971997696:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906909.194557:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755971997696:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 72us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906909.194565:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:3.0:1787906909.194582:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:3.0:1787906909.194590:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971997952:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906909.194614:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971997952:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906909.194620:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:2.0:1787906909.194850:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971997568 00000100:00100000:2.0:1787906909.194855:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971997568 00000100:00100000:2.0:1787906909.194891:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 284 00000100:00100000:2.0:1787906909.194899:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755971997568:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906909.194934:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755971997568:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 36us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906909.194950:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 284 00000100:00080000:1.0:1787906909.197398:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906909.202766:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906909.203017:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971997824 00000100:00100000:3.0:1787906909.203029:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971997824 00000100:00100000:3.0:1787906909.203112:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:3.0:1787906909.203124:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2345:x1874755971997824:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906909.203233:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2345:x1874755971997824:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 112us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906909.203241:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00080000:1.0:1787906909.203309:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787906909.439014:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:0.0:1787906909.856236:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000347392:0@lo:400:kworker.0 00000100:00100000:2.0:1787906909.856284:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000347648:0@lo:400:kworker.0 00000100:00100000:3.0:1787906909.856445:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000347520:0@lo:400:kworker.0 00000100:00100000:1.0:1787906909.856513:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000347776:0@lo:400:kworker.0 00000100:00100000:2.0:1787906909.857129:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906909.857692:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000347648 00000100:00100000:2.0:1787906909.857702:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000347648 00000100:00100000:2.0:1787906909.857783:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787906909.857793:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000347648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906909.858108:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000347648:12345-0@lo:400:kworker.0 Request processed in 315us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906909.858117:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787906909.858177:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000347648:0@lo:400:kworker.0 00000100:00100000:0.0:1787906909.858363:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906909.858409:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa51032b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000347904:0@lo:400:kworker.0 00000100:00100000:0.0:1787906909.858525:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906909.858560:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000347392 00000100:00100000:2.0:1787906909.858566:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000347392 00000100:00100000:0.0:1787906909.858566:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000347904 00000100:00100000:0.0:1787906909.858573:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000347904 00000100:00100000:2.0:1787906909.858602:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787906909.858612:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000347392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906909.858617:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787906909.858628:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000347904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906909.858665:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000347392:12345-0@lo:400:kworker.0 Request processed in 55us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906909.858673:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787906909.858679:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000347904:12345-0@lo:400:kworker.0 Request processed in 52us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906909.858687:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787906909.858752:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000347392:0@lo:400:kworker.0 00000100:00100000:0.0:1787906909.859332:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa51032b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000347904:0@lo:400:kworker.0 00000100:00080000:2.0:1787906909.859446:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906909.860616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906909.860723:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000348032:0@lo:400:kworker.0 00000100:00100000:2.0:1787906909.861045:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000347520 00000100:00100000:2.0:1787906909.861054:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000347520 00000100:00100000:2.0:1787906909.861109:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787906909.861118:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000347520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906909.861703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906909.861850:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000348032 00000100:00100000:0.0:1787906909.861857:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000348032 00000100:00100000:0.0:1787906909.861906:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787906909.861914:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000348032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906909.861962:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000348032:12345-0@lo:400:kworker.0 Request processed in 49us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906909.861969:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1787906909.861996:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787906909.862034:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906909.862084:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000347776 00000100:00100000:1.0:1787906909.862089:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000347776 00000100:00100000:1.0:1787906909.862132:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787906909.862140:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000347776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906909.862341:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787906909.862347:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa534fe6680, transno 4294967300 00000100:00100000:3.0:1787906909.862361:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000348032:0@lo:400:kworker.0 00000100:00080000:0.0:1787906909.862511:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787906909.862534:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510329180 x1874756000347776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906909.862546:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000347776:0@lo:400:kworker.0 00010000:00010000:0.0:1787906909.862581:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906909.863583:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000347776:12345-0@lo:400:kworker.0 Request processed in 1438us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906909.863596:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787906909.863921:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000347520:12345-0@lo:400:kworker.0 Request processed in 2802us (3306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906909.863942:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787906909.864036:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000347520:0@lo:400:kworker.0 00000100:00100000:0.0:1787906910.368714:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000348160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787906910.368847:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906910.369548:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000348160 00000100:00100000:2.0:1787906910.369562:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000348160 00000100:00100000:2.0:1787906910.369641:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787906910.369665:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000348160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787906910.369711:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906910.369783:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000348160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906910.370092:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787906910.370453:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000348160:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787906910.882989:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906911.904028:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906912.928163:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000348288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906912.928236:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906912.928425:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000348288 00000100:00100000:0.0:1787906912.928432:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000348288 00000100:00100000:0.0:1787906912.928510:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787906912.928521:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000348288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787906912.928557:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906912.928618:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000348288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906912.928626:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1787906912.928674:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53495dc00 x1874756000348288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906912.928707:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000348288:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787906912.928973:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787906912.935407:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906913.952268:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906914.315528:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906914.315573:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906914.315617:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906914.315642:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906914.315676:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971998336 00000100:00100000:1.0:1787906914.315688:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971998336 00000100:00100000:1.0:1787906914.315747:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:1.0:1787906914.315760:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa51032b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755971998336:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906914.315892:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa51032b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755971998336:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 135us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906914.315900:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:3.0:1787906914.315982:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971998208 00000100:00100000:3.0:1787906914.315987:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971998208 00000100:00100000:3.0:1787906914.316030:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971998464 00000100:00100000:3.0:1787906914.316034:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971998464 00000100:00100000:3.0:1787906914.316054:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 128 00000100:00100000:3.0:1787906914.316061:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755971998208:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906914.316107:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755971998208:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 46us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906914.316113:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 128 00000100:00100000:3.0:1787906914.316127:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:3.0:1787906914.316146:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971998464:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906914.316170:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971998464:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 38us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906914.316177:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:2.0:1787906914.316299:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971998080 00000100:00100000:2.0:1787906914.316304:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971998080 00000100:00100000:2.0:1787906914.316342:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 286 00000100:00100000:2.0:1787906914.316350:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755971998080:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906914.316377:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755971998080:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906914.316383:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 286 00000100:00080000:2.0:1787906914.316408:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787906914.316412:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787906914.976039:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906914.976074:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000348416:0@lo:400:kworker.0 00000100:00100000:0.0:1787906914.976081:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000348800:0@lo:400:kworker.0 00000100:00100000:1.0:1787906914.976116:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000348544:0@lo:400:kworker.0 00000100:00100000:2.0:1787906914.976177:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000348672:0@lo:400:kworker.0 00000100:00100000:0.0:1787906914.976714:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906914.976804:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000348800 00000100:00100000:0.0:1787906914.976897:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000348800 00000100:00100000:0.0:1787906914.977045:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787906914.977066:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000348800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906914.977188:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000348800:12345-0@lo:400:kworker.0 Request processed in 133us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906914.977195:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1787906914.977231:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa40203c700 x1874756000348800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906914.977244:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000348800:0@lo:400:kworker.0 00000100:00080000:0.0:1787906914.977279:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787906914.978435:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906914.978486:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000348928:0@lo:400:kworker.0 00000100:00100000:3.0:1787906914.978523:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906914.978564:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000348928 00000100:00100000:3.0:1787906914.978571:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000348928 00000100:00100000:3.0:1787906914.978688:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787906914.978698:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000348928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906914.978768:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000348928:12345-0@lo:400:kworker.0 Request processed in 72us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906914.978775:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1787906914.978796:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906914.978837:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000348416 00000100:00100000:0.0:1787906914.978843:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000348416 00000100:00100000:3.0:1787906914.978845:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000348928:0@lo:400:kworker.0 00000100:00100000:0.0:1787906914.978880:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787906914.978887:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000348416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906914.978951:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000348416:12345-0@lo:400:kworker.0 Request processed in 64us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906914.978958:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787906914.979265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906914.979302:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000349056:0@lo:400:kworker.0 00000100:00100000:1.0:1787906914.979330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906914.979366:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000349056 00000100:00100000:1.0:1787906914.979371:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000349056 00000100:00100000:1.0:1787906914.979505:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787906914.979514:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000349056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906914.979556:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000349056:12345-0@lo:400:kworker.0 Request processed in 44us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906914.979563:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787906914.979944:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000349056:0@lo:400:kworker.0 00000100:00100000:0.0:1787906914.981122:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000348544 00000100:00100000:0.0:1787906914.981134:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000348544 00000100:00100000:0.0:1787906914.981180:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787906914.981202:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000348544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906914.981283:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000348544:12345-0@lo:400:kworker.0 Request processed in 82us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906914.981291:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787906914.981309:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000348544:0@lo:400:kworker.0 00000100:00080000:3.0:1787906914.981369:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787906914.981396:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000348416:0@lo:400:kworker.0 00000100:00100000:2.0:1787906914.981441:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906914.981562:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000348672 00000100:00100000:0.0:1787906914.981567:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000348672 00000100:00100000:0.0:1787906914.982013:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787906914.982021:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000348672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906914.982098:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000348672:12345-0@lo:400:kworker.0 Request processed in 78us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906914.982105:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787906914.982172:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000348672:0@lo:400:kworker.0 00000100:00080000:3.0:1787906914.982288:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906915.488210:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787906915.488248:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000349184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787906915.488353:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906915.488652:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000349184 00000100:00100000:2.0:1787906915.488680:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000349184 00000100:00100000:2.0:1787906915.488764:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787906915.488776:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000349184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787906915.489248:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906915.489312:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000349184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 537us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906915.489320:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787906915.489420:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000349184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787906916.000009:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906917.024482:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906918.048152:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906918.048178:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000349312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787906918.048261:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906918.048499:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000349312 00000100:00100000:0.0:1787906918.048509:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000349312 00000100:00100000:0.0:1787906918.048889:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787906918.048901:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000349312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787906918.048953:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906918.049028:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000349312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906918.049036:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1787906918.049141:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53495f480 x1874756000349312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906918.049164:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000349312:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787906918.049292:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787906918.049454:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787906918.816526:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787906919.074987:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906919.442750:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906919.442850:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906919.442995:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971998592 00000100:00100000:2.0:1787906919.443008:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971998592 00000100:00100000:2.0:1787906919.443071:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 288 00000100:00100000:2.0:1787906919.443083:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2343:x1874755971998592:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906919.443169:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2343:x1874755971998592:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 88us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906919.443176:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 288 00000100:00100000:1.0:1787906919.443258:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971998720 00000100:00100000:1.0:1787906919.443263:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971998720 00000100:00100000:1.0:1787906919.443316:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:1.0:1787906919.443324:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755971998720:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906919.443357:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755971998720:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 35us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906919.443363:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00080000:2.0:1787906919.443422:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906919.447988:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906919.448202:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971998848 00000100:00100000:2.0:1787906919.448212:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971998848 00000100:00100000:2.0:1787906919.448293:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:2.0:1787906919.448307:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2342:x1874755971998848:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:2.0:1787906919.448340:0:8459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad410 00000100:00080000:2.0:1787906919.448351:0:8459:0:(import.c:65:import_set_state_nolock()) ffff8aa534c99800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787906919.448396:0:8459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787906919.448674:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+2:2342:x1874755971998848:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 371us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906919.448683:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00010000:00010000:2.0:1787906919.448725:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787906919.449618:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787906919.449861:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906919.449962:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971998976 00000100:00100000:2.0:1787906919.449991:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971998976 00000100:00100000:2.0:1787906919.450064:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00100000:2.0:1787906919.450074:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2343:x1874755971998976:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906919.450149:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2343:x1874755971998976:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906919.450156:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00080000:3.0:1787906919.450334:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1787906919.633948:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 419aebcc-abec-417c-9cd3-22c347ab3c27 00000020:00000080:3.0:1787906919.633957:0:7636:0:(genops.c:885:class_export_put()) final put ffff8aa534c98800/419aebcc-abec-417c-9cd3-22c347ab3c27 00000020:00000080:1.0:1787906919.634030:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa534c98800/419aebcc-abec-417c-9cd3-22c347ab3c27 for lustre-OST0001 00000020:00000080:1.0:1787906919.634079:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa534c99800 for lustre-OST0001 00010000:00010000:0.0:1787906920.096353:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906920.097345:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000349824:0@lo:400:kworker.0 00000100:00100000:2.0:1787906920.097439:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906920.097503:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787906920.097509:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000349696:0@lo:400:kworker.0 00000100:00100000:2.0:1787906920.097536:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906920.097840:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000349440:0@lo:400:kworker.0 00000100:00100000:3.0:1787906920.097879:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906920.097907:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000349952:0@lo:400:kworker.0 00000100:00100000:3.0:1787906920.097929:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906920.097950:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787906920.097955:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000349568:0@lo:400:kworker.0 00000100:00100000:3.0:1787906920.097987:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906920.098005:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000350080:0@lo:400:kworker.0 00000100:00100000:3.0:1787906920.098072:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906920.098104:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000349440 00000100:00100000:3.0:1787906920.098113:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000349440 00000100:00100000:3.0:1787906920.098159:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787906920.098168:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000349440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906920.098243:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000349440:12345-0@lo:400:kworker.0 Request processed in 75us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906920.098250:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787906920.098282:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000349696 00000100:00100000:3.0:1787906920.098286:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000349696 00000100:00100000:3.0:1787906920.098318:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000349952 00000100:00100000:3.0:1787906920.098322:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000349952 00000100:00100000:3.0:1787906920.098332:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000349568 00000100:00100000:3.0:1787906920.098334:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000349568 00000100:00100000:3.0:1787906920.098347:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787906920.098353:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000349696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906920.098392:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000349696:12345-0@lo:400:kworker.0 Request processed in 39us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906920.098398:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787906920.098411:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787906920.098417:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000349952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906920.098442:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000349952:12345-0@lo:400:kworker.0 Request processed in 26us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906920.098448:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787906920.098459:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787906920.098464:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000349568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906920.098495:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000349568:12345-0@lo:400:kworker.0 Request processed in 31us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906920.098500:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1787906920.098517:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906920.098547:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000349696:0@lo:400:kworker.0 00000100:00100000:3.0:1787906920.098580:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000349568:0@lo:400:kworker.0 00000100:00100000:3.0:1787906920.098587:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000349440:0@lo:400:kworker.0 00000100:00100000:3.0:1787906920.098595:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000349952:0@lo:400:kworker.0 00000100:00100000:1.0:1787906920.098971:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000349824 00000100:00100000:1.0:1787906920.098977:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000349824 00000100:00100000:1.0:1787906920.099020:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000350080 00000100:00100000:1.0:1787906920.099023:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000350080 00000100:00100000:1.0:1787906920.099044:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787906920.099051:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000349824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906920.099095:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000349824:12345-0@lo:400:kworker.0 Request processed in 45us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906920.099101:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787906920.099114:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787906920.099120:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000350080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906920.099152:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000350080:12345-0@lo:400:kworker.0 Request processed in 32us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906920.099157:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1787906920.099205:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510210000 x1874756000349824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906920.099230:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000349824:0@lo:400:kworker.0 00000100:00100000:1.0:1787906920.099258:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000350080:0@lo:400:kworker.0 00000100:00080000:3.0:1787906920.099512:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787906920.099516:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787906920.608663:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787906920.608692:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000350208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787906920.608772:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906920.608990:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000350208 00000100:00100000:2.0:1787906920.608999:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000350208 00000100:00100000:2.0:1787906920.609056:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787906920.609066:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000350208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787906920.609106:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906920.609159:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000350208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906920.609167:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787906920.609318:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000350208:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787906921.120755:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906922.144279:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906923.167993:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906923.169035:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000350336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787906923.169108:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906923.169852:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000350336 00000100:00100000:2.0:1787906923.169863:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000350336 00000100:00100000:2.0:1787906923.169943:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787906923.169954:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000350336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787906923.169991:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906923.170128:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000350336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906923.170150:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1787906923.170326:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787906923.172431:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53495c380 x1874756000350336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787906923.172580:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000350336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787906924.193890:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906924.555370:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906924.555426:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906924.555466:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906924.555650:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971999232 00000100:00100000:0.0:1787906924.555662:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971999232 00000100:00100000:0.0:1787906924.555743:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971999360 00000100:00100000:0.0:1787906924.555747:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971999360 00000100:00100000:0.0:1787906924.555774:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 138 00000100:00100000:0.0:1787906924.555786:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2344:x1874755971999232:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906924.555951:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2344:x1874755971999232:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 167us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906924.555958:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 138 00000100:00100000:0.0:1787906924.555985:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 139 00000100:00100000:0.0:1787906924.555993:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2343:x1874755971999360:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:1.0:1787906924.556297:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906924.556505:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2343:x1874755971999360:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 509us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906924.556514:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 139 00000100:00100000:3.0:1787906924.556903:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971999104 00000100:00100000:3.0:1787906924.556912:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971999104 00000100:00100000:3.0:1787906924.556963:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 290 00000100:00100000:3.0:1787906924.556973:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2343:x1874755971999104:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906924.557153:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2343:x1874755971999104:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 181us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906924.557160:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 290 00000100:00100000:2.0:1787906925.216496:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000350464:0@lo:400:kworker.0 00000100:00100000:1.0:1787906925.216498:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000350720:0@lo:400:kworker.0 00000100:00100000:0.0:1787906925.216617:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000350592:0@lo:400:kworker.0 00000100:00100000:1.0:1787906925.216730:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906925.216782:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906925.216956:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000350976:0@lo:400:kworker.0 00000100:00100000:3.0:1787906925.216975:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000350464 00000100:00100000:3.0:1787906925.216987:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000350464 00000100:00100000:2.0:1787906925.216990:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906925.216993:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906925.217004:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000350848:0@lo:400:kworker.0 00000100:00100000:1.0:1787906925.217046:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906925.217070:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787906925.217085:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000350464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906925.217087:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000350720 00000100:00100000:1.0:1787906925.217094:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000350720 00000100:00100000:1.0:1787906925.217139:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000350976 00000100:00100000:1.0:1787906925.217143:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000350976 00000100:00100000:3.0:1787906925.217153:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000350464:12345-0@lo:400:kworker.0 Request processed in 71us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906925.217161:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787906925.217171:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787906925.217181:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000350720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906925.217200:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787906925.217217:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000350976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906925.217230:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000350720:12345-0@lo:400:kworker.0 Request processed in 50us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906925.217238:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787906925.217252:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000350976:12345-0@lo:400:kworker.0 Request processed in 37us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906925.217260:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787906925.217278:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000350848 00000100:00100000:1.0:1787906925.217283:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000350848 00010000:00010000:3.0:1787906925.217323:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906925.217325:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787906925.217336:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000350464:0@lo:400:kworker.0 00000100:00100000:1.0:1787906925.217337:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000350848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906925.217357:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000350976:0@lo:400:kworker.0 00000100:00100000:1.0:1787906925.217387:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000350848:12345-0@lo:400:kworker.0 Request processed in 53us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906925.217396:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787906925.217711:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787906925.217717:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787906925.217744:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa520a55c00 x1874756000350848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906925.217757:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000350848:0@lo:400:kworker.0 00000100:00100000:1.0:1787906925.217771:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000350720:0@lo:400:kworker.0 00000100:00100000:3.0:1787906925.225231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906925.225299:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000351104:0@lo:400:kworker.0 00000100:00100000:1.0:1787906925.225849:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000350592 00000100:00100000:1.0:1787906925.225872:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000350592 00000100:00100000:1.0:1787906925.225964:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787906925.225965:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906925.225978:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000350592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906925.226044:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000350592:12345-0@lo:400:kworker.0 Request processed in 69us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906925.226052:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787906925.226088:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000351104 00000100:00100000:1.0:1787906925.226092:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000351104 00000100:00100000:3.0:1787906925.226132:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000350592:0@lo:400:kworker.0 00000100:00100000:1.0:1787906925.226146:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787906925.226155:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000351104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906925.226194:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000351104:12345-0@lo:400:kworker.0 Request processed in 40us (232us total) trans 0 rc 0/0 00000100:00080000:0.0:1787906925.226216:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787906925.226226:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787906925.226283:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000351104:0@lo:400:kworker.0 00000100:00100000:1.0:1787906925.728631:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000351232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787906925.728731:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906925.729073:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000351232 00000100:00100000:0.0:1787906925.729082:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000351232 00000100:00100000:0.0:1787906925.729180:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787906925.729191:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000351232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787906925.729245:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906925.732710:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000351232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3510us (3969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906925.732727:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787906925.737098:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000351232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906926.243695:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906927.265280:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787906928.035118:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787906928.288932:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906928.297209:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000351360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787906928.297302:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906928.297404:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000351360 00000100:00100000:0.0:1787906928.297415:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000351360 00000100:00100000:0.0:1787906928.297507:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787906928.297518:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000351360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787906928.297564:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906928.297772:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000351360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 255us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906928.297780:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1787906928.297944:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787906928.298121:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510210000 x1874756000351360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787906928.298157:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000351360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787906929.319432:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906929.677479:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906929.677541:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906929.677583:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906929.677700:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971999488 00000100:00100000:2.0:1787906929.677713:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971999488 00000100:00100000:2.0:1787906929.677793:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 292 00000100:00100000:2.0:1787906929.677809:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755971999488:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906929.677928:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755971999488:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 123us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906929.677936:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 292 00000100:00100000:3.0:1787906929.678031:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971999616 00000100:00100000:3.0:1787906929.678037:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971999616 00000100:00100000:3.0:1787906929.678095:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971999744 00000100:00100000:3.0:1787906929.678099:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971999744 00000100:00100000:3.0:1787906929.678126:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 143 00000100:00100000:3.0:1787906929.678135:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755971999616:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906929.678177:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755971999616:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 43us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906929.678184:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 143 00000100:00100000:3.0:1787906929.678197:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 144 00000100:00100000:3.0:1787906929.678215:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971999744:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906929.678253:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755971999744:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906929.678260:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 144 00000100:00080000:2.0:1787906929.678403:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787906929.767545:0:11855:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:48:48 (1787906928) 00000100:00100000:3.0:1787906930.336303:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000351744:0@lo:400:kworker.0 00000100:00100000:2.0:1787906930.336313:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000351872:0@lo:400:kworker.0 00000100:00100000:0.0:1787906930.336385:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000351616:0@lo:400:kworker.0 00000100:00100000:3.0:1787906930.336499:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906930.336506:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000351488:0@lo:400:kworker.0 00000100:00100000:1.0:1787906930.336554:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906930.336593:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000352000:0@lo:400:kworker.0 00000100:00100000:3.0:1787906930.336601:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000351744 00000100:00100000:1.0:1787906930.336619:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906930.336653:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000351488 00000100:00100000:1.0:1787906930.336657:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000351488 00000100:00100000:1.0:1787906930.336711:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787906930.336721:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000351488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906930.336736:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000351744 00000100:00100000:1.0:1787906930.336788:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000351488:12345-0@lo:400:kworker.0 Request processed in 68us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906930.336797:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787906930.336854:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000352000 00000100:00100000:1.0:1787906930.336858:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000352000 00000100:00100000:1.0:1787906930.336896:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787906930.336903:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000351744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906930.336963:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000351744:12345-0@lo:400:kworker.0 Request processed in 60us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906930.336969:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787906930.336985:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787906930.336993:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000352000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906930.337019:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000352000:12345-0@lo:400:kworker.0 Request processed in 28us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906930.337024:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787906930.337061:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000351488:0@lo:400:kworker.0 00000100:00100000:1.0:1787906930.337073:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000352000:0@lo:400:kworker.0 00000100:00100000:1.0:1787906930.337097:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000351744:0@lo:400:kworker.0 00000100:00080000:1.0:1787906930.337129:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906930.337374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906930.337407:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000352128:0@lo:400:kworker.0 00000100:00100000:0.0:1787906930.337436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906930.337474:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000352128 00000100:00100000:0.0:1787906930.337478:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000352128 00000100:00100000:0.0:1787906930.337507:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787906930.337513:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000352128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906930.337556:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000352128:12345-0@lo:400:kworker.0 Request processed in 42us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906930.337562:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787906930.337586:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000351616 00000100:00100000:0.0:1787906930.337590:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000351616 00000100:00100000:0.0:1787906930.337611:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787906930.337617:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000351616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906930.337645:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000351616:12345-0@lo:400:kworker.0 Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906930.337651:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787906930.337680:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000351616:0@lo:400:kworker.0 00000100:00100000:0.0:1787906930.337689:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000352128:0@lo:400:kworker.0 00010000:00010000:1.0:1787906930.338246:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787906930.338254:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787906930.341136:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906930.343107:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000351872 00000100:00100000:1.0:1787906930.343125:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000351872 00000100:00100000:1.0:1787906930.343233:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787906930.343244:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000351872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906930.343354:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000351872:12345-0@lo:400:kworker.0 Request processed in 112us (2225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906930.343361:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1787906930.343493:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa52f366300 x1874756000351872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787906946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787906930.343510:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000351872:0@lo:400:kworker.0 00000100:00080000:2.0:1787906930.343617:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787906930.848356:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000352256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787906930.848458:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906930.848628:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000352256 00000100:00100000:0.0:1787906930.848637:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000352256 00000100:00100000:0.0:1787906930.848689:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787906930.848700:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000352256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787906930.848793:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906930.848881:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000352256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906930.848889:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787906930.849132:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000352256:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906931.360868:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906932.131566:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906932.131905:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755971999872 00000100:00100000:3.0:1787906932.131987:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755971999872 00000100:00080000:2.0:1787906932.132800:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906932.132844:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:3.0:1787906932.132859:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:10244:x1874755971999872:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787906932.132883:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906932.132913:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cad4db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef62c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906932.132991:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad4e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906932.133004:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906932.133019:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906932.133322:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787906932.133327:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906932.133578:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906932.133618:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cad4db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef62c expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906932.133636:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef62c expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906932.133644:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:3.0:1787906932.133647:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787906932.133650:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031a00, rc 0) 00000100:00100000:3.0:1787906932.133765:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:10244:x1874755971999872:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 910us (2212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906932.133773:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:1.0:1787906932.148650:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906932.148775:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972000000 00000100:00100000:0.0:1787906932.148785:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972000000 00000100:00100000:0.0:1787906932.148876:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:0.0:1787906932.148888:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:10245:x1874755972000000:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787906932.148911:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906932.148950:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad4e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef633 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.149016:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad4f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.149030:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad4f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.149040:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad4f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.149053:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad4f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.149059:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.149065:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.149657:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fc00/0x72bb6cf063cad4fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.149669:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fc00/0x72bb6cf063cad4fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.149678:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fc00/0x72bb6cf063cad4fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906932.151767:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787906932.152683:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787906932.153055:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fc00/0x72bb6cf063cad4fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153080:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad4f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153087:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad4f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153094:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad4f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153100:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906932.153105:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad4f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153113:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad4f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153130:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:0.0:1787906932.153133:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906932.153139:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad4f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153144:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad4f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153157:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153163:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad4f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153169:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153180:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906932.153183:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153188:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad4f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153206:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8aa510860600) 00010000:00010000:0.0:1787906932.153209:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906932.153211:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad4f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153216:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad4f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153274:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad4e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef633 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153714:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fc00/0x72bb6cf063cad4fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef633 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906932.153722:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8aa510860200) 00010000:00010000:0.0:1787906932.153735:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787906932.153737:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8fc00, rc 0) 00000100:00100000:0.0:1787906932.154027:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:10245:x1874755972000000:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 5138us (5388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906932.154036:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:0.0:1787906932.162614:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906932.164093:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972000256 00000100:00100000:1.0:1787906932.164125:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972000256 00000100:00100000:1.0:1787906932.164232:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:1.0:1787906932.164248:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+7:10245:x1874755972000256:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787906932.164277:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906932.164307:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad505 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef63a expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.164414:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad50c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.164431:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad50c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.164445:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad50c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.164513:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad513 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.164522:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad513 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.164528:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad513 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165287:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211c00/0x72bb6cf063cad51a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165304:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211c00/0x72bb6cf063cad51a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165314:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211c00/0x72bb6cf063cad51a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906932.165329:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787906932.165590:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad50c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165599:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad50c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165608:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad50c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165615:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210c00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906932.165623:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad50c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165633:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad50c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165649:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8aa510860200) 00010000:00010000:1.0:1787906932.165654:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906932.165660:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad50c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165678:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad50c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165700:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad513 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165706:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad513 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165712:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad513 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165718:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211e00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906932.165721:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad513 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165740:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad513 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165748:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8aa518965c00) 00010000:00010000:1.0:1787906932.165751:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906932.165754:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad513 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.165760:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad513 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.166358:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad505 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef63a expref: 10 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.166389:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211c00/0x72bb6cf063cad51a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef63a expref: 9 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906932.166397:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa518965b00) 00010000:00010000:1.0:1787906932.166400:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906932.166402:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211c00, rc 0) 00000100:00100000:1.0:1787906932.173005:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+9:10245:x1874755972000256:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 8735us (10375us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787906932.173025:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:1.0:1787906932.177791:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906932.177895:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972000384 00000100:00100000:3.0:1787906932.177909:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972000384 00000100:00100000:3.0:1787906932.177984:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:3.0:1787906932.177997:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+9:10245:x1874755972000384:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787906932.178165:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+9:10245:x1874755972000384:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 Request processed in 168us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906932.178175:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00010000:00010000:2.0:1787906932.384836:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787906933.152621:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787906933.408579:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787906933.408615:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000352384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906933.408720:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906933.409094:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000352384 00000100:00100000:3.0:1787906933.409108:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000352384 00000100:00100000:3.0:1787906933.409194:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787906933.409209:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000352384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787906933.409260:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906933.409331:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000352384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906933.409339:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787906933.410943:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787906933.411033:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa510213800 x1874756000352384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787906949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906933.411075:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000352384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787906933.411541:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906934.432020:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906934.566515:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906934.566611:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972000512 00000100:00100000:3.0:1787906934.566623:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972000512 00000100:00100000:3.0:1787906934.566760:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:3.0:1787906934.566771:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+9:10288:x1874755972000512:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906934.566790:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906934.566838:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cad528 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef641 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.566903:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad52f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.566928:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad52f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.566939:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad52f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.566952:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad536 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.566959:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.566964:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567225:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad52f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567239:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad52f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567246:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad52f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567252:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906934.567256:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad52f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567264:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad52f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567275:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:3.0:1787906934.567278:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906934.567282:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad52f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567288:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad52f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567299:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567305:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad536 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567311:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad536 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567316:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906934.567323:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad536 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567329:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad536 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567336:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8aa5069ca000) 00010000:00010000:3.0:1787906934.567338:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906934.567341:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad536 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567347:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad536 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567375:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cad528 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef641 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567384:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:3.0:1787906934.567386:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906934.567390:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cad528 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef641 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.567411:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030000, rc 0) 00000100:00100000:3.0:1787906934.567470:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+9:10288:x1874755972000512:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 701us (966us total) trans 0 rc 301/301 00000100:00100000:3.0:1787906934.567477:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00080000:2.0:1787906934.568888:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906934.600015:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906934.601215:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972000768 00000100:00100000:3.0:1787906934.601229:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972000768 00000100:00100000:3.0:1787906934.601305:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:3.0:1787906934.601324:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+9:10288:x1874755972000768:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:3.0:1787906934.601490:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906934.602014:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad4e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef62c expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.602038:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:3.0:1787906934.602050:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787906934.604772:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad53d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.604803:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad53d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.604868:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad53d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.604888:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cad544 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.604896:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cad544 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.604903:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cad544 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906934.606007:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787906934.606022:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad53d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.606031:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad53d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.606039:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad53d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.606058:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906934.606062:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad53d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.606071:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad53d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.606088:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069aaa00) 00010000:00010000:2.0:1787906934.606091:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906934.606096:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad53d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.606102:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cad53d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787906934.606119:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002caa4432 reply state 00000000b4901b01 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cad544 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906934.606128:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787906934.606262:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+10:10288:x1874755972000768:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 4943us (6257us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787906934.606272:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 37 00010000:00010000:2.0:1787906934.612789:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cad544 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.612832:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cad544 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.612840:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cad544 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.612868:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906934.612874:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cad544 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.612882:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cad544 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.612904:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8aa5069aaf00) 00010000:00010000:2.0:1787906934.612907:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906934.612911:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cad544 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906934.612917:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cad544 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906934.775581:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906934.782735:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972000896 00000100:00100000:3.0:1787906934.782759:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972000896 00000100:00100000:3.0:1787906934.782964:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:3.0:1787906934.782980:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+9:10296:x1874755972000896:12345-192.168.204.20@tcp:101:lctl.0 00010000:00010000:3.0:1787906934.783015:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906934.783046:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad54b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.783138:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cad552 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.783154:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cad552 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.783173:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cad552 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906934.783276:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787906934.783281:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906934.783340:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cad552 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.783372:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad54b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef648 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.783432:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cad552 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef648 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.783443:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:3.0:1787906934.783447:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787906934.783452:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030000, rc 0) 00000100:00100000:3.0:1787906934.783558:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+10:10296:x1874755972000896:12345-192.168.204.20@tcp:101:lctl.0 Request processed in 583us (7996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906934.783567:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:0.0:1787906934.794328:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906934.794405:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906934.794452:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972001024 00000100:00100000:0.0:1787906934.794467:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972001024 00000100:00100000:0.0:1787906934.794533:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 294 00000100:00100000:0.0:1787906934.794546:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755972001024:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906934.794644:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755972001024:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 100us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906934.794652:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 294 00000100:00100000:3.0:1787906934.797028:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972001152 00000100:00100000:3.0:1787906934.797055:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972001152 00000100:00100000:3.0:1787906934.797171:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 148 00000100:00100000:3.0:1787906934.797184:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755972001152:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906934.797317:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755972001152:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 137us (3013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906934.797325:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 148 00000100:00080000:2.0:1787906934.799655:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906934.871569:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906934.871729:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972001280 00000100:00100000:1.0:1787906934.871745:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972001280 00000100:00100000:1.0:1787906934.871915:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:1.0:1787906934.871930:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+10:10302:x1874755972001280:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1787906934.871967:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906934.871999:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cad559 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef64f expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872098:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad560 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872114:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad560 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872125:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad560 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872168:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad567 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872176:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872182:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872380:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad56e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872388:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad56e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872395:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad56e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906934.872438:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787906934.872443:0:10853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787906934.872504:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad56e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872519:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad560 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872526:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad560 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872534:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad560 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872551:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906934.872557:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad560 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872566:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad560 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872583:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:1.0:1787906934.872586:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906934.872593:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad560 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872599:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad560 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872619:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872625:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad567 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872632:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad567 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872637:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906934.872639:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad567 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872645:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad567 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872662:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8aa518965100) 00010000:00010000:1.0:1787906934.872664:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906934.872666:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad567 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872684:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad567 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872722:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cad559 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef64f expref: 12 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872737:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad56e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef64f expref: 11 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906934.872746:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:1.0:1787906934.872749:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787906934.872751:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508210c00, rc 0) 00000100:00100000:1.0:1787906934.872901:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+11:10302:x1874755972001280:12345-192.168.204.20@tcp:101:bash.0 Request processed in 973us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906934.872910:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:3.0:1787906934.876972:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906934.877130:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972001536 00000100:00100000:0.0:1787906934.877148:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972001536 00000100:00100000:0.0:1787906934.877241:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:0.0:1787906934.877255:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+11:10302:x1874755972001536:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1787906934.877296:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906934.877336:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad575 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef656 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.877565:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad57c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.877585:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad57c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.877600:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad57c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.877687:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad583 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.877696:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad583 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.877704:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad583 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787906934.878560:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787906934.878878:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad58a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.878893:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.878903:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.878955:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad57c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.878964:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad57c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.878972:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad57c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.878980:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906934.878986:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad57c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.879008:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad57c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.879026:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:0.0:1787906934.879030:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906934.879036:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad57c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.879041:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad57c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787906934.879061:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6cf7632 reply state 00000000fd4ddca5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad583 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906934.879072:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787906934.879119:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad575 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef656 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.879136:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad58a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef656 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.879143:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa510860400) 00010000:00010000:0.0:1787906934.879145:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906934.879148:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8e000, rc 0) 00000100:00100000:0.0:1787906934.879255:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+14:10302:x1874755972001536:12345-192.168.204.20@tcp:101:bash.0 Request processed in 2003us (2306us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787906934.879266:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 40 00010000:00010000:3.0:1787906934.884865:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad583 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.884889:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad583 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.884900:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad583 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.884908:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906934.884939:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad583 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.884950:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad583 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.884976:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa510860700) 00010000:00010000:3.0:1787906934.884980:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906934.884986:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad583 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.884994:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad583 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906934.897040:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906934.897352:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972001664 00000100:00100000:0.0:1787906934.897388:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972001664 00000100:00100000:0.0:1787906934.897470:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:0.0:1787906934.897484:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2342:x1874755972001664:12345-192.168.204.20@tcp:8:bash.0 00010000:00080000:0.0:1787906934.897536:0:6674:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:0.0:1787906934.897586:0:6674:0:(genops.c:1385:class_connect()) connect: client 419aebcc-abec-417c-9cd3-22c347ab3c27, cookie 0x72bb6cf063cad598 00002000:00100000:0.0:1787906934.897606:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 419aebcc-abec-417c-9cd3-22c347ab3c27/ffff8aa532276800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787906934.897644:0:6674:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787906934.898055:0:6674:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787906934.898098:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8aa532271800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787906934.898180:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2342:x1874755972001664:12345-192.168.204.20@tcp:8:bash.0 Request processed in 697us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906934.898189:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:2.0:1787906934.903062:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906934.903592:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972001792 00000100:00100000:0.0:1787906934.903608:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972001792 00000100:00080000:2.0:1787906934.903785:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906934.903895:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:0.0:1787906934.903910:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:0:x1874755972001792:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1787906934.903932:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906934.903965:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000766d82a6/0x72bb6cf063cad59f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef65d expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787906934.904001:0:8459:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787906934.904030:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=373s v=(0 0) 00010000:00010000:0.0:1787906934.904037:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787906934.904048:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000766d82a6/0x72bb6cf063cad59f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef65d expref: 7 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.904099:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000766d82a6/0x72bb6cf063cad59f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef65d expref: 7 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.904116:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f600, rc 0) 00000100:00100000:0.0:1787906934.904182:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+7:0:x1874755972001792:12345-192.168.204.20@tcp:101:bash.0 Request processed in 277us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906934.905792:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:2.0:1787906934.909479:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906934.909876:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972001920 00000100:00100000:0.0:1787906934.909893:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972001920 00000100:00100000:0.0:1787906934.909969:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:0.0:1787906934.909981:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:10302:x1874755972001920:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1787906934.910007:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906934.910028:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef664 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.910072:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000766d82a6/0x72bb6cf063cad59f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef65d expref: 8 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.910082:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787906934.910087:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787906934.910094:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.910145:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000766d82a6/0x72bb6cf063cad59f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef65d expref: 8 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.910183:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000766d82a6/0x72bb6cf063cad59f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef65d expref: 8 pid: 8459 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906934.910201:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6674:1874756000352512:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906934.910551:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa508255240 going to sleep for 11 seconds 00000100:00100000:0.0:1787906934.914981:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6674:1874756000352512:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906934.915025:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906934.915047:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f400, rc 0) 00000100:00100000:0.0:1787906934.915134:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+8:10302:x1874755972001920:12345-192.168.204.20@tcp:101:bash.0 Request processed in 5153us (5671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906934.915145:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:2.0:1787906934.919639:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906934.919875:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972002048 00000100:00100000:3.0:1787906934.919890:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972002048 00010000:00010000:3.0:1787906934.919957:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000766d82a6/0x72bb6cf063cad59f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef65d expref: 8 pid: 8459 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906934.920003:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:3.0:1787906934.920015:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f364000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972002048:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787906934.920033:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906934.920064:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000766d82a6/0x72bb6cf063cad59f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef65d expref: 8 pid: 8459 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.920081:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000766d82a6/0x72bb6cf063cad59f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef65d expref: 8 pid: 8459 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.920142:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000766d82a6/0x72bb6cf063cad59f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef65d expref: 8 pid: 8459 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.920171:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906934.920177:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906934.920375:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.920390:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906934.920596:0:8506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906934.920620:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8506:1874756000352640:192.168.204.20@tcp:105: 00000100:00100000:2.0:1787906934.922639:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53afb0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787906934.933242:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906934.933696:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972002304 00000100:00100000:0.0:1787906934.933713:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972002304 00000100:00100000:0.0:1787906934.933794:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:0.0:1787906934.933805:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+13:10302:x1874755972002304:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:0.0:1787906934.934333:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+14:10302:x1874755972002304:12345-192.168.204.20@tcp:35:bash.0 Request processed in 526us (1102us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787906934.934343:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:3.0:1787906934.938018:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8506:1874756000352640:192.168.204.20@tcp:105: 00010000:00010000:3.0:1787906934.938056:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906934.938246:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f364000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972002048:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 18231us (18625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906934.938259:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00000001:00080000:3.0:1787906935.109859:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000100:00100000:2.0:1787906935.115951:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906935.116068:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972002560 00000100:00100000:3.0:1787906935.116083:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972002560 00000100:00100000:3.0:1787906935.116163:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:3.0:1787906935.116214:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+10:10312:x1874755972002560:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906935.116318:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906935.116345:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad5ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef66b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906935.116716:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787906935.117052:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad5ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef66b expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.117070:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:3.0:1787906935.117073:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787906935.117078:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad5ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef66b expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.117097:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031a00, rc 0) 00000100:00100000:3.0:1787906935.117181:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+11:10312:x1874755972002560:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 972us (1253us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1787906935.117190:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:0.0:1787906935.121790:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906935.121995:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972002816 00000100:00100000:1.0:1787906935.122006:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972002816 00000100:00100000:1.0:1787906935.122057:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:1.0:1787906935.122068:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+11:10312:x1874755972002816:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1787906935.122719:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+12:10312:x1874755972002816:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 651us (939us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787906935.122728:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:1.0:1787906935.319676:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906935.319999:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972002944 00000100:00100000:3.0:1787906935.320011:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972002944 00000100:00100000:3.0:1787906935.320078:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:3.0:1787906935.320090:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+12:10318:x1874755972002944:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906935.320116:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906935.320139:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad5bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef672 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.320232:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad5c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.320264:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.320276:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906935.320529:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787906935.320533:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906935.320614:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.320647:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad5bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef672 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.320676:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad5c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef672 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.320958:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:3.0:1787906935.320961:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787906935.320965:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030a00, rc 0) 00000100:00100000:3.0:1787906935.321149:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+13:10318:x1874755972002944:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1060us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906935.321158:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:0.0:1787906935.338443:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906935.338594:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972003200 00000100:00100000:1.0:1787906935.338615:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972003200 00000100:00100000:1.0:1787906935.338697:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:1.0:1787906935.338709:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+13:10318:x1874755972003200:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1787906935.338737:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906935.338770:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad5c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef679 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.338950:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad5d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.338966:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.338979:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906935.338990:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787906935.339167:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad5c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef679 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.339191:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad5d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef679 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.339202:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa510860400) 00010000:00010000:1.0:1787906935.339205:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787906935.339209:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211400, rc 0) 00000100:00100000:1.0:1787906935.339522:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+15:10318:x1874755972003200:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 814us (1091us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787906935.339544:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:2.0:1787906935.357440:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906935.357503:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906935.357847:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972003584 00000100:00100000:0.0:1787906935.357881:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972003584 00000100:00100000:0.0:1787906935.357962:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:0.0:1787906935.357985:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f364a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+15:2345:x1874755972003584:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906935.358002:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906935.358032:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad5d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef679 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906935.358057:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa510860400) 00010000:00010000:0.0:1787906935.358061:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906935.358125:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f364a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+14:2345:x1874755972003584:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 143us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906935.358132:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:1.0:1787906935.359081:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972003456 00000100:00100000:1.0:1787906935.359091:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972003456 00000100:00100000:1.0:1787906935.359139:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:1.0:1787906935.359149:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+14:10318:x1874755972003456:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1787906935.359173:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906935.359193:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad5de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef680 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.359372:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad5e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.359389:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.359400:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906935.359413:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787906935.359559:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad5de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef680 expref: 17 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.359581:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad5e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef680 expref: 16 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.359591:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa510860400) 00010000:00010000:1.0:1787906935.359594:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787906935.362084:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211000, rc 0) 00000100:00100000:1.0:1787906935.362279:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+16:10318:x1874755972003456:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 3123us (4847us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787906935.362291:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:2.0:1787906935.407121:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906935.407354:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972003712 00000100:00100000:3.0:1787906935.407371:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972003712 00000100:00100000:3.0:1787906935.407454:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:3.0:1787906935.407467:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972003712:12345-192.168.204.20@tcp:1:lfs.0 00010000:00010000:3.0:1787906935.407524:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cad5f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.407563:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.407572:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906935.407576:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787906935.407581:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cad5f3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.407631:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.407646:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 7 pid: 6674 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906935.407673:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874756000352768:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906935.407791:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53afb0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787906935.414999:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874756000352768:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906935.415033:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cad5f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906935.421060:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906935.421242:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972003840 00000100:00100000:0.0:1787906935.421255:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972003840 00002000:00100000:0.0:1787906935.421316:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8aa52f366a00 x1874755972003840/t0(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:506/0 lens 504/0 e 0 to 0 dl 1787906946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787906935.421330:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa52f366a00 with x1874755972003840 ext(0->12) 00010000:00010000:0.0:1787906935.421341:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 8 pid: 6674 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906935.421361:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 8 pid: 6674 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787906935.421369:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8aa52f366a00 00000100:00100000:0.0:1787906935.421408:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:0.0:1787906935.421418:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2345:x1874755972003840:12345-192.168.204.20@tcp:4:lfs.0 00000100:00100000:2.0:1787906935.457060:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000353152:0@lo:400:kworker.0 00000100:00100000:2.0:1787906935.457145:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906935.457208:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787906935.457224:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000353280:0@lo:400:kworker.0 00000100:00100000:2.0:1787906935.457262:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906935.457977:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000352896:0@lo:400:kworker.0 00000100:00100000:1.0:1787906935.458026:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906935.461590:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000353408:0@lo:400:kworker.0 00000100:00100000:1.0:1787906935.461872:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906935.461938:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787906935.461948:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000353024:0@lo:400:kworker.0 00000100:00100000:1.0:1787906935.462056:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906935.462077:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000353536:0@lo:400:kworker.0 00000100:00100000:1.0:1787906935.462102:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906935.462154:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000353280 00000100:00100000:1.0:1787906935.462166:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000353280 00010000:00010000:2.0:1787906935.462425:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906935.462551:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000353536 00000100:00100000:1.0:1787906935.462555:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000353536 00000100:00100000:3.0:1787906935.462752:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000353152 00000100:00100000:3.0:1787906935.462757:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000353152 00000100:00100000:0.0:1787906935.462832:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000352896 00000100:00100000:0.0:1787906935.462837:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000352896 00000100:00100000:0.0:1787906935.462869:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787906935.462878:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000352896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906935.462943:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000352896:12345-0@lo:400:kworker.0 Request processed in 66us (4916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906935.462952:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787906935.463079:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000353408 00000100:00100000:0.0:1787906935.463084:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000353408 00000100:00080000:2.0:1787906935.463473:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787906935.463478:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787906935.463480:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787906935.463543:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787906935.463552:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000353280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906935.463652:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000353280:12345-0@lo:400:kworker.0 Request processed in 45us (6342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906935.463670:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787906935.463688:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787906935.463694:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000353536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906935.463723:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000353536:12345-0@lo:400:kworker.0 Request processed in 30us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906935.463728:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787906935.463797:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000353536:0@lo:400:kworker.0 00000100:00100000:1.0:1787906935.463827:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000352896:0@lo:400:kworker.0 00000100:00100000:1.0:1787906935.463880:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000353280:0@lo:400:kworker.0 00000100:00100000:3.0:1787906935.464038:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000353024 00000100:00100000:3.0:1787906935.464045:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000353024 00000100:00100000:3.0:1787906935.464065:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787906935.464079:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000353152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906935.464119:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000353152:12345-0@lo:400:kworker.0 Request processed in 42us (6975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906935.464125:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787906935.464138:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787906935.464144:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000353024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906935.464173:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000353024:12345-0@lo:400:kworker.0 Request processed in 30us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906935.464179:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787906935.465499:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000353024:0@lo:400:kworker.0 00000100:00100000:3.0:1787906935.465560:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000353152:0@lo:400:kworker.0 00000100:00100000:0.0:1787906935.481247:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787906935.481282:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000353408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906935.481417:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000353408:12345-0@lo:400:kworker.0 Request processed in 143us (19543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906935.481425:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787906935.481488:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000353408:0@lo:400:kworker.0 00000001:00100000:0.0:1787906935.518953:0:6699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 419aebcc-abec-417c-9cd3-22c347ab3c27 00000001:00080000:0.0:1787906935.557138:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1787906935.557533:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972003840:12345-192.168.204.20@tcp:4:lfs.0 Request processed in 136106us (136474us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787906935.557553:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00002000:00100000:1.0:1787906935.557569:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8aa52f366a00 x1874755972003840/t4294967299(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:506/0 lens 504/448 e 0 to 0 dl 1787906946 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787906935.557579:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa52f366a00 with x1874755972003840 ext(0->12) 00010000:00010000:1.0:1787906935.557590:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 7 pid: 6674 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.557623:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 7 pid: 6674 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787906935.557632:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8aa52f366a00 00000100:00100000:2.0:1787906935.563144:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906935.563285:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972003968 00000100:00100000:0.0:1787906935.563382:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972003968 00010000:00010000:0.0:1787906935.563495:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 7 pid: 6674 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906935.563584:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:0.0:1787906935.563595:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2344:x1874755972003968:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906935.563612:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787906935.563645:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787906935.563648:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787906934 00002000:00010000:0.0:1787906935.563651:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787906935 00002000:00010000:0.0:1787906935.563653:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787906934 00002000:00010000:0.0:1787906935.563655:0:5817:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1787906935.563674:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 7 pid: 6674 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906935.563689:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 7 pid: 6674 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906935.563712:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a41f9a4/0x72bb6cf063cad5a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef664 expref: 7 pid: 6674 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906935.563731:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787906935.563735:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787906935.563742:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cad5f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906935.563752:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cad5f3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906935.563792:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906935.563900:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2344:x1874755972003968:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 306us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906935.563907:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00010000:00010000:1.0:1787906935.563977:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cad5f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.563987:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cad5f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.564016:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cad5f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.564036:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cad5f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.564043:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cad5f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.564050:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:1.0:1787906935.564056:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cad5f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.564064:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cad5f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.564079:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cad5f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.564086:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cad5f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906935.564133:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755972003712:12345-192.168.204.20@tcp:1:lfs.0 Request processed in 156668us (157023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906935.564141:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:0.0:1787906935.568129:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906935.568344:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972004224 00000100:00100000:1.0:1787906935.568356:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972004224 00000100:00100000:1.0:1787906935.568553:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1787906935.568571:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+16:10318:x1874755972004224:12345-192.168.204.20@tcp:35:lfs.0 00000004:00010000:1.0:1787906935.568652:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad5e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef680 expref: 16 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787906935.572747:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787906935.572847:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787906935.573638:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1787906935.573727:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.573755:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad58a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef656 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.573767:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.573864:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad58a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef656 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.573883:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad58a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef656 expref: 20 pid: 5832 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906935.573900:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520a57480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1874756000353664:192.168.204.20@tcp:104: 00000100:00100000:1.0:1787906935.574627:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa506904540 going to sleep for 11 seconds 00000100:00100000:0.0:1787906935.578039:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906935.578149:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520a57480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1874756000353664:192.168.204.20@tcp:104: 00010000:00010000:1.0:1787906935.578187:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906935.578275:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972004352 00000100:00100000:2.0:1787906935.578282:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972004352 00010000:00010000:2.0:1787906935.578325:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad58a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef656 expref: 21 pid: 5832 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906935.578368:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:2.0:1787906935.578378:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+21:2345:x1874755972004352:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906935.578402:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906935.578411:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad58a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef656 expref: 21 pid: 5832 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906935.578423:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad58a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef656 expref: 21 pid: 5832 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906935.578448:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad58a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef656 expref: 21 pid: 5832 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906935.578465:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa510860400) 00010000:00010000:2.0:1787906935.578470:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906935.578487:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906935.578494:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906935.578524:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906935.578583:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+20:2345:x1874755972004352:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 205us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906935.578590:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 37 00010000:00010000:1.0:1787906935.578647:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.578655:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787906935.578809:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787906935.579098:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1787906935.579209:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520a57480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1874756000353792:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787906935.579294:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906935.579321:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5069043c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787906935.579862:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000353792 00000100:00100000:2.0:1787906935.579868:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000353792 00000100:00100000:2.0:1787906935.579908:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787906935.579916:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874756000353792:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787906935.580000:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874756000353792:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906935.580007:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787906935.580184:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520a57480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1874756000353792:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787906935.580889:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787906935.580969:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520a57480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1874756000353920:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787906935.581015:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906935.581044:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa506904540 going to sleep for 11 seconds 00000100:00100000:2.0:1787906935.581451:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000353920 00000100:00100000:2.0:1787906935.581458:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000353920 00000100:00100000:2.0:1787906935.581505:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787906935.581512:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874756000353920:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787906935.581784:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1874756000353920:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 271us (767us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787906935.581791:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787906935.582020:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520a57480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1874756000353920:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787906935.582081:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787906935.582124:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.582136:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.582145:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.582151:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906935.582166:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.582175:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.582201:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa510860400) 00010000:00010000:1.0:1787906935.582204:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787906935.582208:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.582214:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad5fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787906935.582566:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787906935.582863:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787906935.582877:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373855062963ns, next at 374855060580ns, rc = 0 00000001:00080000:1.0:1787906935.582883:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787906935.582917:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa510860400) 00010000:00010000:1.0:1787906935.582920:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787906935.582928:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad5e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef680 expref: 24 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906935.583055:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+23:10318:x1874755972004224:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 14486us (14934us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787906935.583064:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000020:00080000:1.0:1787906935.583068:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787906935.591086:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906935.591285:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972004480 00000100:00100000:3.0:1787906935.591304:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972004480 00000100:00100000:3.0:1787906935.591375:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:3.0:1787906935.591388:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+23:10318:x1874755972004480:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906935.591429:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906935.591461:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad601 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef687 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.591530:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad601 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef687 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.591545:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad601 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef687 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906935.591589:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906935.591592:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787906935.591597:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031200, rc 0) 00000100:00100000:3.0:1787906935.591939:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+24:10318:x1874755972004480:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 552us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906935.591948:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:2.0:1787906935.597774:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906935.597946:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972004736 00000100:00100000:0.0:1787906935.598017:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972004736 00000100:00100000:0.0:1787906935.598113:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:0.0:1787906935.598125:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52939b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+24:10318:x1874755972004736:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1787906935.598582:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52939b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+25:10318:x1874755972004736:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 458us (820us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1787906935.598590:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:0.0:1787906935.715052:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906935.715221:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972004992 00000100:00100000:1.0:1787906935.715232:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972004992 00000100:00100000:1.0:1787906935.715320:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:1.0:1787906935.715334:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+25:10328:x1874755972004992:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1787906935.715383:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906935.715412:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad608 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef68e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906935.715767:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787906935.716011:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad608 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef68e expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.716027:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:1.0:1787906935.716030:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787906935.716035:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef68e expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.716050:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211000, rc 0) 00000100:00100000:1.0:1787906935.716126:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+26:10328:x1874755972004992:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 797us (1095us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787906935.716135:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:2.0:1787906935.720061:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906935.720210:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972005120 00000100:00100000:1.0:1787906935.720221:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972005120 00000100:00100000:1.0:1787906935.720288:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:1.0:1787906935.720308:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+26:10328:x1874755972005120:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:1.0:1787906935.720406:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad616 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.720424:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad616 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.720437:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad616 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.720473:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad61d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.720480:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.720487:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.720912:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad624 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.720923:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.720931:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787906935.721007:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721023:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad616 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721031:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad616 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721038:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad616 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721045:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906935.721050:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad616 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721064:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad616 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721077:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:1.0:1787906935.721081:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906935.721085:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad616 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721091:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad616 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721104:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721110:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad61d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721116:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad61d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721121:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906935.721124:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad61d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721130:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad61d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721137:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa518965300) 00010000:00010000:1.0:1787906935.721140:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906935.721143:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad61d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721160:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad61d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721177:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721183:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad624 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721187:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721192:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906935.721194:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721199:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad624 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721206:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:1.0:1787906935.721208:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906935.721211:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad624 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.721215:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad624 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906935.721297:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+26:10328:x1874755972005120:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 990us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906935.721306:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:2.0:1787906935.725546:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906935.725909:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972005376 00000100:00100000:1.0:1787906935.725920:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972005376 00000100:00100000:1.0:1787906935.725978:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:1.0:1787906935.725988:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+26:10328:x1874755972005376:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1787906935.726757:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+27:10328:x1874755972005376:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 766us (1222us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787906935.726767:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1787906935.800205:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906935.800305:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972005632 00000100:00100000:1.0:1787906935.800317:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972005632 00000100:00100000:1.0:1787906935.800381:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:1.0:1787906935.800393:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+27:10331:x1874755972005632:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1787906935.800415:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906935.800436:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad62b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef695 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.800520:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad632 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.800536:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad632 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.800550:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad632 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.800564:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.800570:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.800599:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801004:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad640 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801013:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad640 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801020:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad640 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906935.801029:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787906935.801107:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad632 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801113:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad632 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801119:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad632 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801124:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906935.801128:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad632 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801136:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad632 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801148:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:1.0:1787906935.801150:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906935.801159:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad632 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801166:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad632 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801180:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801185:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad639 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801190:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801195:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906935.801197:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801203:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801210:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa518965300) 00010000:00010000:1.0:1787906935.801212:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906935.801215:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad639 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801220:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cad639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801257:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad62b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef695 expref: 30 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801279:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad640 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef695 expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.801285:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:1.0:1787906935.801287:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787906935.801289:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211000, rc 0) 00000100:00100000:1.0:1787906935.801361:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+29:10331:x1874755972005632:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 969us (1165us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1787906935.801368:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:2.0:1787906935.813080:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906935.813272:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972005760 00000100:00100000:1.0:1787906935.813286:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972005760 00000100:00100000:1.0:1787906935.813360:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:1.0:1787906935.813372:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+29:10331:x1874755972005760:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1787906935.813480:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad64e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.813507:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad64e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.813523:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad64e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.813556:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad64e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.813563:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad64e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.813592:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad64e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.814520:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906935.814528:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad64e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.814541:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad64e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.814561:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:1.0:1787906935.814565:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787906935.814574:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad64e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906935.814581:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad64e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906935.816917:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+29:10331:x1874755972005760:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 3537us (3840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906935.816932:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:2.0:1787906935.830623:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906935.830721:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972006016 00000100:00100000:1.0:1787906935.830734:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972006016 00000100:00100000:1.0:1787906935.830803:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:1.0:1787906935.830857:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+29:10331:x1874755972006016:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1787906935.831161:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+30:10331:x1874755972006016:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 348us (571us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787906935.831170:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:3.0:1787906935.973204:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000354048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787906935.973313:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906935.973438:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000354048 00000100:00100000:0.0:1787906935.973450:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000354048 00000100:00100000:0.0:1787906935.973516:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787906935.973527:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000354048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787906935.973567:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906935.973629:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000354048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906935.973636:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787906935.973777:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000354048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787906936.125560:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906936.125695:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972006272 00000100:00100000:0.0:1787906936.125710:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972006272 00000100:00100000:0.0:1787906936.125889:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:0.0:1787906936.125901:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+30:10362:x1874755972006272:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:0.0:1787906936.125946:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1787906936.126040:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787906936.126094:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad655 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef69c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.126199:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad65c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.126213:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad65c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.126225:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad65c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906936.126237:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787906936.126387:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad655 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef69c expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.126419:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad65c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef69c expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.126428:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:0.0:1787906936.126431:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906936.126435:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f800, rc 0) 00000100:00100000:0.0:1787906936.126542:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+32:10362:x1874755972006272:12345-192.168.204.20@tcp:101:cat.0 Request processed in 644us (990us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787906936.126550:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:3.0:1787906936.136141:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906936.136227:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972006400 00000100:00100000:2.0:1787906936.136237:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972006400 00000100:00100000:2.0:1787906936.136303:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:2.0:1787906936.136315:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510224850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+32:2345:x1874755972006400:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906936.136333:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906936.136357:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad65c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef69c expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.136378:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:2.0:1787906936.136384:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906936.136440:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510224850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+31:2345:x1874755972006400:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 127us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906936.136448:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:3.0:1787906936.138053:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906936.138182:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972006656 00000100:00100000:0.0:1787906936.138192:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972006656 00000100:00100000:0.0:1787906936.138236:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:0.0:1787906936.138257:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+31:10362:x1874755972006656:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:0.0:1787906936.138612:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+32:10362:x1874755972006656:12345-192.168.204.20@tcp:35:cat.0 Request processed in 355us (567us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787906936.138621:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1787906936.277953:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906936.278101:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972006912 00000100:00100000:3.0:1787906936.278113:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972006912 00000100:00100000:3.0:1787906936.278191:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:3.0:1787906936.278203:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+32:10368:x1874755972006912:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1787906936.278235:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906936.278239:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787906936.278273:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad5c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef672 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.278300:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:3.0:1787906936.278307:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787906936.278321:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad66a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef6a3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.278454:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.278471:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad640 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef695 expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.278482:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.278520:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad640 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef695 expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.278535:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad640 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef695 expref: 32 pid: 5830 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906936.278549:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000354176:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906936.278655:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53afb0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787906936.281664:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000354176:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906936.281699:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906936.287139:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906936.287275:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972007040 00000100:00100000:2.0:1787906936.287290:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972007040 00010000:00010000:2.0:1787906936.287339:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad640 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef695 expref: 33 pid: 5830 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906936.287376:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:2.0:1787906936.287386:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f364a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+33:2345:x1874755972007040:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906936.287401:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906936.287409:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad640 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef695 expref: 33 pid: 5830 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.287434:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad640 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef695 expref: 33 pid: 5830 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.287463:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad640 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef695 expref: 33 pid: 5830 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.287485:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:2.0:1787906936.287491:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.287501:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.287508:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.287540:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906936.287610:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f364a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+32:2345:x1874755972007040:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 225us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906936.287619:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00010000:00010000:3.0:1787906936.287689:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.287699:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906936.287721:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787906936.287952:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad66a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6a3 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.288299:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6a3 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.288307:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906936.288310:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787906936.288312:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030800, rc 0) 00000100:00100000:3.0:1787906936.288344:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+32:10368:x1874755972006912:12345-192.168.204.20@tcp:101:dd.0 Request processed in 10143us (10403us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787906936.288352:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:1.0:1787906936.294115:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906936.294590:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972007296 00000100:00100000:3.0:1787906936.294613:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972007296 00000100:00100000:3.0:1787906936.294691:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:3.0:1787906936.294702:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+32:10368:x1874755972007296:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:3.0:1787906936.295121:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad67f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.295137:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad67f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.295148:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad67f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787906936.295235:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787906936.295260:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006781f56e reply state 00000000c2851a04 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad67f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906936.295268:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787906936.295393:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+35:10368:x1874755972007296:12345-192.168.204.20@tcp:36:dd.0 Request processed in 691us (1286us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787906936.295401:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000020:00080000:3.0:1787906936.295406:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787906936.300449:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad67f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.300475:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad67f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.300484:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad67f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.300513:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906936.300519:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad67f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.300527:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad67f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.300545:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:2.0:1787906936.300548:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906936.300553:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad67f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.300560:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad67f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906936.480283:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906936.614925:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906936.615618:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972007424 00000100:00100000:0.0:1787906936.615630:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972007424 00000100:00100000:0.0:1787906936.615707:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:0.0:1787906936.615718:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+34:10382:x1874755972007424:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:0.0:1787906936.615742:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906936.615763:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cad686 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef6aa expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.615853:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad68d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.615865:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad68d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.615875:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad68d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.615888:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.615894:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.615900:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.616231:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad69b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.616243:0:10853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6a3 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.617157:0:10853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad69b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.617205:0:10853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6a3 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906936.617219:0:10853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6a3 expref: 35 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906936.617234:0:10853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000354304:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906936.617548:0:10853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50306da80 going to sleep for 11 seconds 00000100:00100000:0.0:1787906936.625293:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906936.625383:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972007680 00000100:00100000:1.0:1787906936.625392:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972007680 00000100:00100000:1.0:1787906936.625450:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:1.0:1787906936.625460:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+36:5586:x1874755972007680:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787906936.626434:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+37:5586:x1874755972007680:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 971us (1147us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787906936.626445:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1787906936.627685:0:10853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000354304:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906936.627714:0:10853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad69b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906936.647987:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906936.648223:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972007808 00000100:00100000:2.0:1787906936.648238:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972007808 00010000:00010000:2.0:1787906936.648308:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6a3 expref: 37 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906936.648399:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:2.0:1787906936.648410:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f367b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+37:2346:x1874755972007808:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906936.648428:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906936.648436:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6a3 expref: 37 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.648451:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6a3 expref: 37 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.648495:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad671 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6a3 expref: 37 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.648511:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:2.0:1787906936.648516:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad69b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.648730:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.648737:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad69b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906936.648773:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906936.648875:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f367b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+36:2346:x1874755972007808:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 466us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906936.648882:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00010000:00010000:3.0:1787906936.649630:0:10853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649650:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906936.649697:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787906936.649701:0:10853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906936.649742:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649754:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649763:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad68d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649770:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad68d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649777:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad68d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649782:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8ec00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906936.649796:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad68d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649803:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad68d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649833:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:3.0:1787906936.649836:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906936.649840:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad68d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649847:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad68d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649861:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649867:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad694 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649875:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649880:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906936.649883:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649888:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649896:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa510860700) 00010000:00010000:3.0:1787906936.649899:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906936.649907:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad694 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649913:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cad694 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649951:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cad686 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6aa expref: 36 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649964:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad69b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6aa expref: 35 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.649972:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906936.649974:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787906936.649976:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f600, rc 0) 00000100:00100000:3.0:1787906936.650032:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+35:10382:x1874755972007424:12345-192.168.204.20@tcp:101:stat.0 Request processed in 34316us (35116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906936.650039:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:1.0:1787906936.787261:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906936.787943:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972008064 00000100:00100000:3.0:1787906936.787954:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972008064 00000100:00100000:3.0:1787906936.788018:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:3.0:1787906936.788029:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+35:10388:x1874755972008064:12345-192.168.204.20@tcp:36:truncate.0 00010000:00010000:3.0:1787906936.788084:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906936.788114:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad69b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6aa expref: 35 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.788135:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906936.788140:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787906936.788872:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.788889:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.788900:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787906936.788962:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1787906936.788988:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047c22dbd reply state 0000000008441c06 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906936.788998:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787906936.789148:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+37:10388:x1874755972008064:12345-192.168.204.20@tcp:36:truncate.0 Request processed in 1119us (1907us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787906936.789156:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00000020:00080000:3.0:1787906936.789161:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787906936.795980:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.796001:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.796009:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.796015:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906936.796020:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.796027:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.796063:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906936.796066:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906936.796071:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906936.796077:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906937.092534:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906937.092851:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972008192 00000100:00100000:3.0:1787906937.092870:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972008192 00000100:00100000:3.0:1787906937.092972:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:3.0:1787906937.092987:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+36:10402:x1874755972008192:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:3.0:1787906937.093021:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906937.093052:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef6b1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.093156:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.093174:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.093188:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.093205:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.093212:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.093243:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.096874:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad6be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.096898:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad6be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.096913:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad6be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906937.096970:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787906937.096976:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906937.097001:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad6be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097016:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad6be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097026:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097033:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097041:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097046:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906937.097052:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097069:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097083:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:3.0:1787906937.097087:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906937.097092:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097098:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097114:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097120:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097125:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097129:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906937.097132:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097137:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097143:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa5069ca400) 00010000:00010000:3.0:1787906937.097157:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906937.097160:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097176:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097224:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6b1 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097239:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad6be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6b1 expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.097247:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906937.097249:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787906937.097252:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031a00, rc 0) 00000100:00100000:3.0:1787906937.097428:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+37:10402:x1874755972008192:12345-192.168.204.20@tcp:101:stat.0 Request processed in 4441us (4901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906937.097438:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:0.0:1787906937.244921:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906937.245056:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972008448 00000100:00100000:1.0:1787906937.245074:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972008448 00000100:00100000:1.0:1787906937.245160:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:1.0:1787906937.245173:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+37:10412:x1874755972008448:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1787906937.245200:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906937.245227:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad6c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef6b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906937.245692:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787906937.245963:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad6c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6b8 expref: 39 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906937.245985:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:1.0:1787906937.245988:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787906937.246004:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad6c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6b8 expref: 39 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906937.246024:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508210a00, rc 0) 00000100:00100000:1.0:1787906937.246125:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+38:10412:x1874755972008448:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 954us (1218us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787906937.246134:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:1.0:1787906937.255047:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906937.255163:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972008704 00000100:00100000:2.0:1787906937.255177:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972008704 00000100:00100000:2.0:1787906937.255252:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:2.0:1787906937.255281:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+38:10412:x1874755972008704:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1787906937.255929:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+39:10412:x1874755972008704:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 663us (895us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787906937.255939:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:2.0:1787906937.321098:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906937.321294:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972008960 00000100:00100000:3.0:1787906937.321311:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972008960 00000100:00100000:3.0:1787906937.321387:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:3.0:1787906937.321400:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+39:10418:x1874755972008960:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1787906937.321435:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906937.321464:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef6bf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.321623:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.321652:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad6be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6b1 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.321678:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.321732:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad6be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6b1 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.321750:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad6be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6b1 expref: 40 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906937.321772:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000354432:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906937.321956:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53afb00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787906937.336460:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000354432:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906937.336514:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906937.342926:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906937.343184:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972009088 00000100:00100000:0.0:1787906937.343199:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972009088 00010000:00010000:0.0:1787906937.343255:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad6be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6b1 expref: 41 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906937.343316:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:0.0:1787906937.343328:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+41:2346:x1874755972009088:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906937.343350:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906937.343376:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad6be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6b1 expref: 41 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.343392:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad6be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6b1 expref: 41 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.343418:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad6be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6b1 expref: 41 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.343439:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:0.0:1787906937.343445:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.343457:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.343465:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.343510:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906937.343581:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+40:2346:x1874755972009088:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 255us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906937.343590:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 40 00010000:00010000:3.0:1787906937.346236:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.346257:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906937.346304:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787906937.346854:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6bf expref: 41 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.346882:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6bf expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.346916:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906937.346919:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787906937.346924:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030a00, rc 0) 00000100:00100000:3.0:1787906937.347098:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+40:10418:x1874755972008960:12345-192.168.204.20@tcp:101:bash.0 Request processed in 25699us (26013us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787906937.347111:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:2.0:1787906937.364938:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906937.365080:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972009344 00000100:00100000:1.0:1787906937.365096:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972009344 00000100:00100000:1.0:1787906937.365189:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:1.0:1787906937.365204:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+40:10418:x1874755972009344:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:1.0:1787906937.365757:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cad6e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906937.365779:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cad6e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906937.365792:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cad6e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787906937.365899:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1787906937.365927:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d3a63d3 reply state 00000000ff9687d0 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cad6e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906937.365938:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787906937.366075:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+43:10418:x1874755972009344:12345-192.168.204.20@tcp:36:bash.0 Request processed in 872us (1150us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787906937.366084:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00000020:00080000:1.0:1787906937.366091:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787906937.375095:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cad6e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.375139:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cad6e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.375149:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cad6e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.375157:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906937.375164:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cad6e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.375183:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cad6e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.375210:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:2.0:1787906937.375214:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906937.375219:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cad6e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.375226:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cad6e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906937.379030:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906937.379171:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972009472 00000100:00100000:3.0:1787906937.379187:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972009472 00000100:00100000:3.0:1787906937.379269:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:3.0:1787906937.379282:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+42:10418:x1874755972009472:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1787906937.379316:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906937.379344:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef6c6 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.379776:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.379796:0:10853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6bf expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.379806:0:10853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6f6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.380228:0:10853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6bf expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.380249:0:10853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6bf expref: 43 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906937.380276:0:10853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000354560:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906937.380442:0:10853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53afb0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787906937.383430:0:10853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000354560:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906937.383469:0:10853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906937.384312:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906937.384714:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972009600 00000100:00100000:1.0:1787906937.384726:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972009600 00010000:00010000:1.0:1787906937.384779:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6bf expref: 44 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906937.384955:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:1.0:1787906937.384967:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+44:2345:x1874755972009600:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906937.384986:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906937.384995:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6bf expref: 44 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906937.385010:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6bf expref: 44 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906937.385050:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad6da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6bf expref: 44 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906937.385074:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:1.0:1787906937.385079:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906937.385090:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906937.385100:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6f6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906937.385134:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906937.385223:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+43:2345:x1874755972009600:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 257us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906937.385252:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00010000:00010000:3.0:1787906937.385330:0:10853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.385339:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906937.385414:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787906937.385420:0:10853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906937.385449:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.385491:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6c6 expref: 43 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.385523:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6c6 expref: 42 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.385531:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906937.385534:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787906937.385537:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030800, rc 0) 00000100:00100000:3.0:1787906937.385571:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+42:10418:x1874755972009472:12345-192.168.204.20@tcp:101:bash.0 Request processed in 6292us (6557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906937.386782:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:2.0:1787906937.391799:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906937.391898:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972009856 00000100:00100000:0.0:1787906937.391912:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972009856 00000100:00100000:0.0:1787906937.391987:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:0.0:1787906937.392002:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa529398c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+42:10418:x1874755972009856:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:0.0:1787906937.392379:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa529398c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+43:10418:x1874755972009856:12345-192.168.204.20@tcp:35:bash.0 Request processed in 380us (596us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1787906937.392410:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:1.0:1787906937.478358:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906937.478530:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972010112 00000100:00100000:3.0:1787906937.478545:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972010112 00000100:00100000:3.0:1787906937.478647:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:3.0:1787906937.478661:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+43:10428:x1874755972010112:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906937.478698:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906937.478728:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef6cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906937.479113:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787906937.479341:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6cd expref: 45 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.479360:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:3.0:1787906937.479364:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787906937.479370:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad6fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6cd expref: 45 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.479389:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030200, rc 0) 00000100:00100000:3.0:1787906937.479476:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+44:10428:x1874755972010112:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 818us (1135us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1787906937.479485:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:2.0:1787906937.483170:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906937.483286:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972010240 00000100:00100000:0.0:1787906937.483297:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972010240 00000100:00100000:0.0:1787906937.483389:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:0.0:1787906937.483501:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+44:10428:x1874755972010240:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:0.0:1787906937.483603:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad70b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.483634:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad70b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.483649:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad70b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.483671:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad712 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.483679:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.483687:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484223:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad719 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484236:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484244:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787906937.484311:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484328:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad70b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484335:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad70b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484343:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad70b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484350:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906937.484356:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad70b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484364:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad70b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484379:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:0.0:1787906937.484382:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906937.484388:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad70b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484394:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad70b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484412:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484418:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad712 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484431:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484437:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906937.484440:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484447:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad712 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484455:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa510860e00) 00010000:00010000:0.0:1787906937.484458:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906937.484461:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad712 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484467:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad712 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484484:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484491:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad719 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484496:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad719 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484501:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906937.484504:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad719 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484522:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad719 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484530:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:0.0:1787906937.484532:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906937.484536:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad719 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.484542:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad719 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906937.484663:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+44:10428:x1874755972010240:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 1163us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906937.484674:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:2.0:1787906937.491337:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906937.491388:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972010496 00000100:00100000:0.0:1787906937.491415:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972010496 00000100:00100000:0.0:1787906937.491531:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:0.0:1787906937.491544:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+44:10428:x1874755972010496:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1787906937.492296:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+45:10428:x1874755972010496:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 750us (970us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787906937.492308:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00010000:00010000:3.0:1787906937.504044:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906937.518169:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906937.518282:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972010752 00000100:00100000:3.0:1787906937.518295:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972010752 00000100:00100000:3.0:1787906937.518355:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:3.0:1787906937.518365:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+45:10431:x1874755972010752:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906937.518414:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906937.518442:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad720 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef6d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.518544:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad727 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.518562:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad727 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.518575:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad727 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.518590:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad72e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.518598:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad72e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.518605:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad72e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519075:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad735 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519083:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519088:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906937.519097:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787906937.519218:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad727 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519227:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad727 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519234:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad727 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519242:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906937.519247:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad727 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519267:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad727 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519283:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:3.0:1787906937.519287:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906937.519293:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad727 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519299:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad727 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519315:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad72e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519322:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad72e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519328:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad72e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519333:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906937.519345:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad72e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519352:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad72e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519360:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa5069ca400) 00010000:00010000:3.0:1787906937.519364:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906937.519366:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad72e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519373:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad72e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519446:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad720 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6d4 expref: 48 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519463:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad735 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6d4 expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.519471:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906937.519474:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787906937.519477:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511995000, rc 0) 00000100:00100000:3.0:1787906937.519572:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+47:10431:x1874755972010752:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1207us (1415us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787906937.519582:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:2.0:1787906937.527966:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906937.528139:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906937.528451:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972011008 00000100:00100000:0.0:1787906937.528462:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972011008 00000100:00100000:0.0:1787906937.528533:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:0.0:1787906937.528545:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+47:2345:x1874755972011008:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906937.528564:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906937.528591:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad735 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6d4 expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.528635:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:0.0:1787906937.528640:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906937.528709:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+46:2345:x1874755972011008:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 166us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906937.528717:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:3.0:1787906937.532293:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972010880 00000100:00100000:3.0:1787906937.532309:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972010880 00000100:00100000:3.0:1787906937.532427:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:3.0:1787906937.532440:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+46:10431:x1874755972010880:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:3.0:1787906937.532541:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad743 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.532558:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.532569:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.532596:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.532603:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad743 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.532610:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.532616:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511995400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906937.532637:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.532644:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad743 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.532655:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906937.532658:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787906937.532661:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad743 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.532667:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad743 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906937.532764:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+46:10431:x1874755972010880:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 326us (8146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906937.532771:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:2.0:1787906937.537849:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906937.538035:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972011264 00000100:00100000:1.0:1787906937.538046:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972011264 00000100:00100000:1.0:1787906937.538102:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:1.0:1787906937.538114:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+46:10431:x1874755972011264:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1787906937.538532:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+47:10431:x1874755972011264:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 418us (729us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787906937.538540:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1787906937.660492:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906937.664147:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972011520 00000100:00100000:0.0:1787906937.664164:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972011520 00000100:00100000:0.0:1787906937.664312:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:0.0:1787906937.664326:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+47:10449:x1874755972011520:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:0.0:1787906937.664353:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906937.664377:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad74a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef6db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.664480:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad751 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.664493:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad751 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.664517:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad751 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906937.664530:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787906937.664668:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad74a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6db expref: 50 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.664689:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad751 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6db expref: 49 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.664711:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:0.0:1787906937.664714:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787906937.664718:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8e000, rc 0) 00000100:00100000:0.0:1787906937.664792:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+49:10449:x1874755972011520:12345-192.168.204.20@tcp:101:cat.0 Request processed in 469us (4309us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787906937.664799:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:2.0:1787906937.703778:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906937.703924:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972011648 00000100:00100000:0.0:1787906937.703935:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972011648 00000100:00100000:0.0:1787906937.703995:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:0.0:1787906937.704007:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+49:10450:x1874755972011648:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1787906937.704034:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906937.704055:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad75f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef6e2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.704124:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad766 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.704166:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.704178:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906937.704681:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787906937.704686:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787906937.704767:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.704806:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad75f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6e2 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.704863:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6e2 expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906937.704872:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:0.0:1787906937.704875:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787906937.704878:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f200, rc 0) 00000100:00100000:0.0:1787906937.704936:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+50:10450:x1874755972011648:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 933us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906937.704944:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:2.0:1787906937.717213:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906937.717395:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972012032 00000100:00100000:0.0:1787906937.717406:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972012032 00000100:00100000:0.0:1787906937.717474:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:0.0:1787906937.717486:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+50:10450:x1874755972012032:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1787906937.717887:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+51:10450:x1874755972012032:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 401us (684us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787906937.717896:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:2.0:1787906937.720907:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906937.721064:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972012160 00000100:00100000:3.0:1787906937.721074:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972012160 00000100:00100000:3.0:1787906937.721143:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:3.0:1787906937.721337:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+51:10450:x1874755972012160:12345-192.168.204.20@tcp:103:lfs.0 00010000:00010000:3.0:1787906937.721360:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787906937.721392:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad6f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6c6 expref: 51 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.721419:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad751 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6db expref: 50 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.721434:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad601 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef687 expref: 49 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.721445:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906937.721458:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906937.721792:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+48:10450:x1874755972012160:12345-192.168.204.20@tcp:103:lfs.0 Request processed in 639us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906937.721801:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:2.0:1787906937.731792:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906937.732039:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972012288 00000100:00100000:3.0:1787906937.732050:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972012288 00000100:00100000:3.0:1787906937.732107:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:3.0:1787906937.732116:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+48:10450:x1874755972012288:12345-192.168.204.20@tcp:58:lfs.0 00010000:00010000:3.0:1787906937.732260:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad76d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.732277:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad76d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906937.732291:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad76d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787906937.733211:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787906937.733843:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787906937.733928:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787906937.735047:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+48:10450:x1874755972012288:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 2923us (3255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906937.735060:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:2.0:1787906937.785263:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906937.786806:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972012416 00000100:00100000:0.0:1787906937.786832:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972012416 00000100:00100000:2.0:1787906937.791398:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:2.0:1787906937.791413:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+48:10452:x1874755972012416:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906937.791433:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906937.791455:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad774 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef6e9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.791521:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad77b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.791536:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad77b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.791557:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad77b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.791571:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad782 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.791578:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.791583:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.791927:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad789 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.791942:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.791964:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906937.791999:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787906937.792003:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906937.792024:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792035:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792043:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad77b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792049:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad77b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792056:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad77b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792062:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906937.792065:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad77b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792072:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad77b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792085:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:2.0:1787906937.792087:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906937.792099:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad77b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792105:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad77b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792117:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792122:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad782 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792127:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad782 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792132:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906937.792147:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad782 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792159:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad782 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792167:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa5069aaf00) 00010000:00010000:2.0:1787906937.792169:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906937.792172:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad782 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792177:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad782 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792208:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad774 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6e9 expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792234:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad789 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6e9 expref: 49 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906937.792242:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca400) 00010000:00010000:2.0:1787906937.792244:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787906937.792246:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97400, rc 0) 00000100:00100000:2.0:1787906937.794316:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+49:10452:x1874755972012416:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 2894us (9051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906937.794329:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000040:00080000:0.0:1787906938.281283:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787906938.281294:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787906938.281349:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787906938.281356:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787906938.281486:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874756000354688:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787906938.281628:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50a3cc780 going to sleep for 11 seconds 00000100:00100000:0.0:1787906938.285451:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874756000354688:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787906938.288219:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906938.289030:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972012544 00000100:00100000:3.0:1787906938.289045:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972012544 00000100:00100000:3.0:1787906938.289133:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:3.0:1787906938.289156:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:419aebcc-abec-417c-9cd3-22c347ab3c27+49:10463:x1874755972012544:12345-192.168.204.20@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787906938.289269:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:419aebcc-abec-417c-9cd3-22c347ab3c27+49:10463:x1874755972012544:12345-192.168.204.20@tcp:900:lhsmtool_posix.0 Request processed in 125us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906938.289278:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00080000:0.0:1787906938.289761:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906938.293005:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906938.293201:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972012672 00000100:00100000:0.0:1787906938.293215:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972012672 00000100:00100000:0.0:1787906938.293295:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:0.0:1787906938.293308:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+49:10463:x1874755972012672:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787906938.293352:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787906938.293545:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+49:10463:x1874755972012672:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 238us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906938.293554:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:3.0:1787906938.333593:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906938.334110:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972012800 00000100:00100000:0.0:1787906938.334132:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972012800 00000100:00100000:0.0:1787906938.334215:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:0.0:1787906938.334229:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+49:10463:x1874755972012800:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787906938.334334:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad790 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334353:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad790 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334366:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad790 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334383:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad797 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334391:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad797 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334430:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad797 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334461:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad79e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334470:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334487:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906938.334533:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787906938.334538:0:10853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787906938.334553:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334566:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad790 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334573:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad790 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334580:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad790 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334587:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906938.334592:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad790 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334599:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad790 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334631:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa518965b00) 00010000:00010000:0.0:1787906938.334634:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906938.334639:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad790 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334646:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad790 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334664:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad797 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334671:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad797 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334675:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad797 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334680:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906938.334683:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad797 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334689:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad797 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334695:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8aa510860e00) 00010000:00010000:0.0:1787906938.334698:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906938.334700:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad797 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334705:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad797 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334733:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334738:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad79e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334744:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad79e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334749:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906938.334752:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad79e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334757:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad79e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334763:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca400) 00010000:00010000:0.0:1787906938.334766:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906938.334768:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad79e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.334773:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad79e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906938.334878:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+49:10463:x1874755972012800:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 651us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906938.334886:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:1.0:1787906938.347864:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906938.347896:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972013056 00000100:00100000:1.0:1787906938.347905:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972013056 00000100:00100000:1.0:1787906938.347961:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:1.0:1787906938.347971:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+49:10463:x1874755972013056:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787906938.347990:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906938.348010:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad7a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef6f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.348100:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad7ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.348114:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad7ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.348135:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad7ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906938.348158:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787906938.348277:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad7ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.348285:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad7ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.348291:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad7ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.348297:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906938.348301:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad7ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.348308:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad7ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.348320:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca400) 00010000:00010000:1.0:1787906938.348323:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787906938.348327:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad7ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.348333:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad7ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.348370:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad7a5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6f0 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.348379:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa518965b00) 00010000:00010000:1.0:1787906938.348381:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787906938.348391:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad7a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6f0 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.348411:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508210000, rc 0) 00000100:00100000:1.0:1787906938.348462:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+50:10463:x1874755972013056:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 492us (605us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1787906938.348469:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:1.0:1787906938.359508:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906938.359956:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972013184 00000100:00100000:3.0:1787906938.359969:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972013184 00000100:00100000:3.0:1787906938.360040:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:3.0:1787906938.360051:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+50:10463:x1874755972013184:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787906938.360108:0:10853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787906938.360231:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+50:10463:x1874755972013184:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 181us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906938.360239:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:1.0:1787906938.374382:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906938.374717:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972013440 00000100:00100000:0.0:1787906938.374729:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972013440 00000100:00100000:0.0:1787906938.374792:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:0.0:1787906938.374846:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+50:10463:x1874755972013440:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787906938.374869:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906938.374872:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787906938.374901:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad766 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6e2 expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.374920:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:0.0:1787906938.374925:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787906938.374941:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad7ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef6f7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787906938.376033:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787906938.379738:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad7c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.379764:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.379777:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.380476:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad7ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6f7 expref: 52 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.380500:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6f7 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.380510:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa510860e00) 00010000:00010000:0.0:1787906938.380513:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906938.380600:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8e000, rc 0) 00000100:00100000:0.0:1787906938.380703:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+51:10463:x1874755972013440:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 5889us (6332us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787906938.380713:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:1.0:1787906938.384582:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906938.384843:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972013696 00000100:00100000:3.0:1787906938.384857:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972013696 00000100:00100000:3.0:1787906938.384919:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:3.0:1787906938.384932:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+51:10463:x1874755972013696:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787906938.385009:0:10853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906938.385041:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad7c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6f7 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385060:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa510860e00) 00010000:00010000:3.0:1787906938.385072:0:10853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787906938.385097:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cad7cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385113:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cad7cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385123:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cad7cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385200:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad7d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xeb646a13 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385210:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad7d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb646a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385251:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad7d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb646a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385639:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cad7cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385648:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cad7cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385655:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cad7cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385661:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511995800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906938.385665:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cad7cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385679:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cad7cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385690:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:3.0:1787906938.385693:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906938.385697:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cad7cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385703:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cad7cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385714:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad7d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb646a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385720:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad7d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb646a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385733:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad7d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb646a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385738:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511995000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906938.385741:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad7d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb646a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385748:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad7d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb646a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385756:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xeb646a13 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906938.385759:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906938.385762:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad7d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xeb646a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.385768:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cad7d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xeb646a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906938.385928:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+50:10463:x1874755972013696:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 997us (1358us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787906938.385938:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:1.0:1787906938.389969:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906938.390052:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972013824 00000100:00100000:3.0:1787906938.390065:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972013824 00000100:00100000:3.0:1787906938.390130:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:3.0:1787906938.390141:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+50:10463:x1874755972013824:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787906938.390165:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906938.390200:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad7dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef6fe expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.390265:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad7e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.390279:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.390291:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.390401:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad7dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6fe expref: 52 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.390425:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad7e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6fe expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.390435:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:3.0:1787906938.390438:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787906938.390442:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030800, rc 0) 00000100:00100000:3.0:1787906938.390504:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+51:10463:x1874755972013824:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 365us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906938.390512:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:1.0:1787906938.394937:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906938.395201:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972014080 00000100:00100000:3.0:1787906938.395214:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972014080 00000100:00100000:3.0:1787906938.395295:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:3.0:1787906938.395307:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+51:10463:x1874755972014080:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787906938.395405:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad7eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.395444:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad7eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.395460:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad7eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787906938.398181:0:10853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1787906938.398198:0:10853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376670384415ns, next at 377670381571ns, rc = 0 00000004:00010000:3.0:1787906938.398361:0:10853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002840ee59 reply state 00000000cdcbe264 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad7eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906938.398373:0:10853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787906938.398493:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+53:10463:x1874755972014080:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 3185us (3569us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787906938.398502:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 75 00010000:00010000:3.0:1787906938.404198:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad7eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.404218:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad7eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.404226:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad7eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.404233:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906938.404238:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad7eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.404257:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad7eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.404289:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:3.0:1787906938.404292:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787906938.404297:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad7eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.404304:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad7eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906938.407626:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906938.407703:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972014208 00000100:00100000:0.0:1787906938.407714:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972014208 00000100:00100000:0.0:1787906938.407778:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:0.0:1787906938.407789:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+52:10463:x1874755972014208:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787906938.407838:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906938.407864:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad7f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef705 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.407925:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef705 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.407940:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef705 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.407958:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:0.0:1787906938.407961:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787906938.407965:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8e800, rc 0) 00000100:00100000:0.0:1787906938.408027:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+53:10463:x1874755972014208:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 239us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906938.408034:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:3.0:1787906938.413837:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906938.413991:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972014336 00000100:00100000:0.0:1787906938.414005:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972014336 00000100:00100000:0.0:1787906938.414062:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:0.0:1787906938.414072:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2342:x1874755972014336:12345-192.168.204.20@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787906938.414145:0:6675:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp t0 exp 0000000000000000 cur 376 last 0 00000020:00000080:0.0:1787906938.414192:0:6675:0:(genops.c:1385:class_connect()) connect: client 419aebcc-abec-417c-9cd3-22c347ab3c27, cookie 0x72bb6cf063cad7f9 00002000:00100000:0.0:1787906938.414205:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 419aebcc-abec-417c-9cd3-22c347ab3c27/ffff8aa532273000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787906938.414232:0:6675:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787906938.414509:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787906938.414557:0:6675:0:(import.c:65:import_set_state_nolock()) ffff8aa532277800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787906938.414649:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2342:x1874755972014336:12345-192.168.204.20@tcp:8:lhsmtool_posix.0 Request processed in 577us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906938.414659:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:1.0:1787906938.428455:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906938.428651:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972014464 00000100:00100000:3.0:1787906938.428666:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972014464 00000100:00100000:3.0:1787906938.428747:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:3.0:1787906938.428759:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:0:x1874755972014464:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787906938.429657:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1787906938.503899:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 419aebcc-abec-417c-9cd3-22c347ab3c27 00000001:00080000:0.0:1787906938.503919:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1787906938.504621:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+5:0:x1874755972014464:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 75847us (76161us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787906938.504632:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:1.0:1787906938.514360:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906938.514471:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972014720 00000100:00100000:3.0:1787906938.514484:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972014720 00000100:00100000:3.0:1787906938.514571:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:3.0:1787906938.514584:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+53:10463:x1874755972014720:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787906938.514908:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+54:10463:x1874755972014720:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 325us (558us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787906938.514916:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:1.0:1787906938.518868:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906938.519127:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972014976 00000100:00100000:3.0:1787906938.519139:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972014976 00000100:00100000:3.0:1787906938.519328:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:3.0:1787906938.519339:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+54:10463:x1874755972014976:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787906938.519443:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+54:10463:x1874755972014976:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 106us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906938.519465:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 77 00010000:00010000:2.0:1787906938.528547:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787906938.529538:0:7109:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376801723305ns, next at 377801719681ns, rc = 0 00000100:00100000:3.0:1787906938.529571:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f7b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000354816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787906938.529646:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906938.529736:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000354816 00000100:00100000:3.0:1787906938.529744:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000354816 00000100:00100000:3.0:1787906938.529806:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787906938.529846:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5345da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874756000354816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787906938.529879:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906938.529926:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5345da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874756000354816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906938.529934:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1787906938.530394:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787906938.530444:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f7b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000354816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787906938.533766:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906938.533802:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972015104 00000100:00100000:3.0:1787906938.533828:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972015104 00000100:00100000:3.0:1787906938.533890:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:3.0:1787906938.533901:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+54:10463:x1874755972015104:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787906938.533923:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906938.533944:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad800 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef70c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.534019:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad807 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.534051:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.534064:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906938.534102:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906938.534120:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.534161:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad800 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef70c expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.534189:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef70c expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.534197:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:3.0:1787906938.534200:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787906938.534204:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030200, rc 0) 00000100:00100000:3.0:1787906938.534268:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+55:10463:x1874755972015104:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 369us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906938.534276:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:3.0:1787906938.544091:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906938.544196:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972015232 00000100:00100000:1.0:1787906938.544205:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972015232 00000100:00100000:1.0:1787906938.544270:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:1.0:1787906938.544283:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755972015232:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787906938.544301:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906938.544327:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cad80e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef713 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787906938.544355:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a914b7a, blocks: 0x1 00010000:00010000:1.0:1787906938.544376:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1787906938.544380:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787906938.544405:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cad80e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef713 expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.544428:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cad80e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef713 expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.544444:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508210a00, rc 0) 00000100:00100000:1.0:1787906938.544506:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755972015232:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 225us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906938.544514:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:3.0:1787906938.560916:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906938.561135:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972015488 00000100:00100000:0.0:1787906938.561147:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972015488 00000100:00100000:0.0:1787906938.561205:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:0.0:1787906938.561216:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+55:10463:x1874755972015488:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787906938.561338:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+55:10463:x1874755972015488:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 123us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906938.561347:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:0.0:1787906938.570447:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906938.570694:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972015616 00000100:00100000:3.0:1787906938.570707:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972015616 00000100:00100000:3.0:1787906938.570771:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:3.0:1787906938.570783:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:10463:x1874755972015616:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787906938.570850:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906938.570874:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb37552b/0x72bb6cf063cad815 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef71a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.570908:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cad80e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef713 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.570916:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906938.570920:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906938.570926:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb37552b/0x72bb6cf063cad815 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef71a expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.570967:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cad80e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef713 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.570981:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cad80e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef713 expref: 7 pid: 6675 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906938.570998:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f7b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1874756000354944:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906938.571103:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507232c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906938.578887:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906938.578963:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972015744 00000100:00100000:1.0:1787906938.578973:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972015744 00010000:00010000:1.0:1787906938.579024:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cad80e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef713 expref: 8 pid: 6675 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906938.579073:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:1.0:1787906938.579084:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510225450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2345:x1874755972015744:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906938.579102:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906938.579140:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cad80e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef713 expref: 8 pid: 6675 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.579156:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cad80e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef713 expref: 8 pid: 6675 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.579191:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787906938.579196:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787906938.579218:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb37552b/0x72bb6cf063cad815 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef71a expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.579229:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb37552b/0x72bb6cf063cad815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef71a expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906938.579276:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eb37552b/0x72bb6cf063cad815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef71a expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906938.579291:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f7eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5816:1874756000355072:192.168.204.20@tcp:105: 00000100:00100000:1.0:1787906938.579365:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa506904180 going to sleep for 11 seconds 00010000:00010000:3.0:1787906938.580656:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cad80e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef713 expref: 8 pid: 6675 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906938.580678:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f7b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1874756000354944:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906938.580706:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb37552b/0x72bb6cf063cad815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef71a expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.580730:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031200, rc 0) 00000100:00100000:3.0:1787906938.580785:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:10463:x1874755972015616:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 10004us (10350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906938.580793:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:1.0:1787906938.583897:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f7eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5816:1874756000355072:192.168.204.20@tcp:105: 00010000:00010000:1.0:1787906938.583923:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906938.583978:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510225450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755972015744:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 4896us (5100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906938.583989:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:1.0:1787906938.587967:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906938.589731:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972015872 00000100:00100000:3.0:1787906938.589748:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972015872 00002000:00100000:3.0:1787906938.589844:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8aa53f7eca80 x1874755972015872/t0(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:509/0 lens 504/0 e 0 to 0 dl 1787906949 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787906938.589856:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa53f7eca80 with x1874755972015872 ext(0->8) 00002000:00010000:3.0:1787906938.589862:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa53f7eca80 00000100:00100000:3.0:1787906938.589897:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1787906938.589907:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755972015872:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787906938.590720:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2345:x1874755972015872:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 Request processed in 811us (2759us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787906938.590731:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00002000:00100000:3.0:1787906938.590741:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8aa53f7eca80 x1874755972015872/t4294967302(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:509/0 lens 504/448 e 0 to 0 dl 1787906949 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787906938.590749:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa53f7eca80 with x1874755972015872 ext(0->8) 00002000:00010000:3.0:1787906938.590753:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa53f7eca80 00000100:00100000:3.0:1787906938.596168:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906938.596960:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972016000 00000100:00100000:1.0:1787906938.596976:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972016000 00000100:00100000:1.0:1787906938.597085:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:1.0:1787906938.597098:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+55:10463:x1874755972016000:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787906938.757082:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000100:00100000:1.0:1787906938.758230:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+55:10463:x1874755972016000:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 159415us (160358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906938.758266:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00000004:00080000:3.0:1787906938.758546:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787906938.758575:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa5069043c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787906938.758587:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa53ad89000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa506904600 00000020:00080000:3.0:1787906938.758590:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa53ad89700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa51a6ba400 00000004:00080000:3.0:1787906938.758638:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1787906938.758645:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1787906938.758650:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1787906938.758681:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787906938.758857:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787906938.763752:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f7b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000355200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787906938.763875:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906938.765401:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000355200 00000100:00100000:1.0:1787906938.765410:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000355200 00000100:00100000:1.0:1787906938.765476:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787906938.765486:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000355200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787906938.765671:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787906938.765676:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787906938 00002000:00010000:1.0:1787906938.765679:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787906938.765681:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787906938 -> 1787906938 00002000:00010000:1.0:1787906938.765684:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787906938.765750:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874756000355200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 265us (1874us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787906938.765759:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787906938.765792:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787906938.765845:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa53f7b2300/2, rc 0, transno 4294967303 00000100:00100000:1.0:1787906938.765852:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f7b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000355200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787906938.765863:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787906938.765871:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f7ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000355328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787906938.765905:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906938.766469:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000355328 00000100:00100000:0.0:1787906938.766476:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000355328 00000100:00100000:0.0:1787906938.766514:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787906938.766542:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1874756000355328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787906938.766562:0:8459:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787906938.766595:0:8459:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a914b76, atime: 0x6a914b77, ctime: 0x6a914b76, blocks: 0xb 00010000:00010000:0.0:1787906938.766615:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a96e189/0x72bb6cf063cad81c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.766631:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787906938.766636:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787906938.766642:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a96e189/0x72bb6cf063cad81c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.766660:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a96e189/0x72bb6cf063cad81c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.766672:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a96e189/0x72bb6cf063cad81c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.766682:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a96e189/0x72bb6cf063cad81c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.766703:0:8459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787906938.767945:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1874756000355328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1400us (2034us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787906938.767970:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1787906938.768000:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787906938.768009:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a96e189/0x72bb6cf063cad81c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.768036:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f200 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787906938.768042:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a96e189/0x72bb6cf063cad81c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.768052:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a96e189/0x72bb6cf063cad81c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.768074:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a96e189/0x72bb6cf063cad81c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.768080:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a96e189/0x72bb6cf063cad81c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.768104:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906938.768106:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906938.768107:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787906938.769489:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa53f7ed500/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787906938.769516:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f7ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000355328:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787906938.778434:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906938.779309:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972016128 00000100:00100000:1.0:1787906938.779322:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972016128 00000100:00100000:1.0:1787906938.779396:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:1.0:1787906938.779408:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972016128:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787906938.935400:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1787906938.935436:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1787906938.936759:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755972016128:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 156816us (157802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906938.939352:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906938.939831:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:0.0:1787906938.950938:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972016384 00000100:00100000:0.0:1787906938.951009:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972016384 00000100:00100000:0.0:1787906938.951084:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:0.0:1787906938.951094:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+13:10463:x1874755972016384:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787906938.951147:0:10853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906938.951176:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad807 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef70c expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.951205:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:0.0:1787906938.951210:0:10853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787906938.951241:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad823 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.951253:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906938.951263:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787906938.951503:0:10853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076808594 reply state 00000000a74a1ec4 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906938.951512:0:10853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787906938.952790:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+14:10463:x1874755972016384:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1682us (13433us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787906938.952800:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:3.0:1787906938.970938:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:2.0:1787906938.971020:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906938.971033:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad823 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906938.971042:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906938.971048:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906938.971053:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906938.971062:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad823 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906938.971078:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:2.0:1787906938.971093:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906938.971099:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad823 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906938.971106:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad823 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906938.971150:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972016512 00000100:00100000:2.0:1787906938.971160:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972016512 00000100:00100000:2.0:1787906938.971221:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:2.0:1787906938.971232:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755972016512:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787906938.971502:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787906938.971506:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787906938 -> 1787906937 00002000:00010000:2.0:1787906938.971509:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787906935 00002000:00010000:2.0:1787906938.971512:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787906938 -> 1787906937 00002000:00010000:2.0:1787906938.971514:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787906938.971605:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972016512:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 374us (676us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787906938.971614:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:3.0:1787906938.974445:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906938.974480:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972016768 00000100:00100000:3.0:1787906938.974489:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972016768 00000100:00100000:3.0:1787906938.974543:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:3.0:1787906938.974555:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+13:10463:x1874755972016768:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787906938.974789:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.974806:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad7e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6fe expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.974834:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.974875:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad7e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6fe expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906938.974889:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad7e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6fe expref: 13 pid: 5831 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906938.974903:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f7b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874756000355456:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906938.974981:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507232a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787906938.989491:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f7b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874756000355456:192.168.204.20@tcp:104: 00010000:00010000:2.0:1787906938.989540:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906939.004024:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906939.004617:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972016896 00000100:00100000:2.0:1787906939.004628:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972016896 00010000:00010000:2.0:1787906939.004680:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad7e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6fe expref: 14 pid: 5831 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906939.004729:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:2.0:1787906939.004748:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+14:2345:x1874755972016896:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906939.004765:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906939.004772:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad7e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6fe expref: 14 pid: 5831 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.004789:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad7e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6fe expref: 14 pid: 5831 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.004831:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad7e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6fe expref: 14 pid: 5831 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.004845:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:2.0:1787906939.004851:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.004861:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.004869:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.004901:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906939.004955:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+13:2345:x1874755972016896:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 208us (941us total) trans 0 rc 0/0 00010000:00010000:0.0:1787906939.004961:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906939.004965:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00010000:00010000:0.0:1787906939.004976:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.005007:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.005014:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.005027:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.005033:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906939.005038:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.005046:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.005055:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:0.0:1787906939.005058:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787906939.005062:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.005067:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad82a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906939.005109:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+12:10463:x1874755972016768:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 Request processed in 30556us (30672us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787906939.005118:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:3.0:1787906939.009445:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906939.009516:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972017024 00000100:00100000:2.0:1787906939.009526:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972017024 00000100:00100000:2.0:1787906939.009599:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:2.0:1787906939.009611:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2344:x1874755972017024:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787906939.009661:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e074c48d/0x72bb6cf063cad831 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.009682:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb37552b/0x72bb6cf063cad815 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef71a expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.009691:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787906939.009695:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787906939.009700:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e074c48d/0x72bb6cf063cad831 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.009735:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb37552b/0x72bb6cf063cad815 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef71a expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.009750:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb37552b/0x72bb6cf063cad815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef71a expref: 7 pid: 6673 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906939.009765:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6674:1874756000355584:192.168.204.20@tcp:104: 00000100:00100000:2.0:1787906939.009863:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787906939.014757:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6674:1874756000355584:192.168.204.20@tcp:104: 00010000:00010000:2.0:1787906939.014788:0:6674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e074c48d/0x72bb6cf063cad831 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906939.029045:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906939.036855:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972017152 00000100:00100000:0.0:1787906939.036869:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972017152 00010000:00010000:0.0:1787906939.036914:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb37552b/0x72bb6cf063cad815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef71a expref: 8 pid: 6673 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906939.036959:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:0.0:1787906939.036968:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2345:x1874755972017152:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906939.036992:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906939.037017:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb37552b/0x72bb6cf063cad815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef71a expref: 8 pid: 6673 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.037032:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb37552b/0x72bb6cf063cad815 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef71a expref: 8 pid: 6673 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.037056:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb37552b/0x72bb6cf063cad815 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef71a expref: 8 pid: 6673 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.037072:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787906939.037076:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787906939.037082:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e074c48d/0x72bb6cf063cad831 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.037092:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e074c48d/0x72bb6cf063cad831 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.037128:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906939.037184:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972017152:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 217us (8148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906939.037191:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00010000:00010000:2.0:1787906939.038644:0:6674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e074c48d/0x72bb6cf063cad831 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.038674:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e074c48d/0x72bb6cf063cad831 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.038703:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e074c48d/0x72bb6cf063cad831 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.038712:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e074c48d/0x72bb6cf063cad831 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.038720:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e074c48d/0x72bb6cf063cad831 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.038728:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787906939.038731:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e074c48d/0x72bb6cf063cad831 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.038740:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e074c48d/0x72bb6cf063cad831 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.038755:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e074c48d/0x72bb6cf063cad831 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.038763:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e074c48d/0x72bb6cf063cad831 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906939.038928:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2344:x1874755972017024:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 29316us (29487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906939.038938:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000040:00080000:3.0:1787906939.046242:0:12008:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787906939.046252:0:12008:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787906939.046288:0:12008:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787906939.046293:0:12008:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787906939.051925:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906939.052402:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972017408 00000100:00100000:1.0:1787906939.052412:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972017408 00000100:00100000:1.0:1787906939.053042:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:1.0:1787906939.053055:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+12:10463:x1874755972017408:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787906939.053149:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad838 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906939.053167:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad838 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906939.053180:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad838 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906939.053389:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906939.053400:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad7f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef705 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906939.053409:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906939.053445:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef705 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906939.053460:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad7f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef705 expref: 13 pid: 5831 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906939.053475:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f7ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000355712:192.168.204.20@tcp:104: 00000100:00100000:1.0:1787906939.053553:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa506904540 going to sleep for 11 seconds 00000100:00100000:1.0:1787906939.074944:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906939.074978:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972017536 00000100:00100000:1.0:1787906939.074986:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972017536 00010000:00010000:1.0:1787906939.075029:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad7f2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef705 expref: 14 pid: 5831 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906939.075077:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:1.0:1787906939.075087:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+14:2346:x1874755972017536:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906939.075114:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906939.075122:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad7f2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef705 expref: 14 pid: 5831 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906939.075136:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad7f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef705 expref: 14 pid: 5831 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906939.075159:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:1.0:1787906939.075164:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906939.075174:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906939.075182:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906939.075201:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906939.075253:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+14:2346:x1874755972017536:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 168us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906939.075260:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00010000:00010000:3.0:1787906939.075968:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad7f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef705 expref: 13 pid: 5831 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906939.075987:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f7ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000355712:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906939.076006:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.076016:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.076022:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787906939.076217:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1787906939.076363:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1787906939.076653:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1787906939.076748:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f7b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874756000355840:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787906939.076798:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906939.076859:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5103c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1787906939.078116:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000355840 00000100:00100000:1.0:1787906939.078126:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000355840 00000100:00100000:1.0:1787906939.078171:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787906939.078180:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1874756000355840:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787906939.078297:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1874756000355840:12345-0@lo:1000:mdt00_002.0 Request processed in 118us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906939.078304:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787906939.078747:0:5832:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787906939.078754:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa53f7b2300, transno 4294967303 00000100:00100000:2.0:1787906939.078772:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f7b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874756000355840:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787906939.079266:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787906939.079340:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b048700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874756000355968:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787906939.079384:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906939.080573:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507232600 going to sleep for 11 seconds 00000100:00100000:1.0:1787906939.081856:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000355968 00000100:00100000:1.0:1787906939.081866:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000355968 00000100:00100000:1.0:1787906939.081917:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787906939.081925:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1874756000355968:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787906939.082161:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1874756000355968:12345-0@lo:1000:mdt00_002.0 Request processed in 237us (2777us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787906939.082169:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787906939.084744:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b048700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874756000355968:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787906939.084792:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.084803:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.084838:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.084852:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906939.084857:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.084865:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.084892:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:2.0:1787906939.084895:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787906939.084900:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.084907:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad83f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.084944:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad76d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.084950:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad76d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.084956:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad76d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.084961:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511995400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906939.084964:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad76d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.084970:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad76d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.084977:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca400) 00010000:00010000:2.0:1787906939.084979:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787906939.084982:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad76d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.084987:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad76d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.085298:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.085313:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad789 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6e9 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.085322:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.085356:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad789 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6e9 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906939.085372:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad789 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6e9 expref: 16 pid: 5832 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906939.085385:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b04a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000356096:192.168.204.20@tcp:104: 00000100:00100000:2.0:1787906939.086970:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa501668000 going to sleep for 11 seconds 00000100:00100000:1.0:1787906939.103177:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906939.103414:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b04a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000356096:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906939.103443:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906939.103536:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972017664 00000100:00100000:0.0:1787906939.103543:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972017664 00010000:00010000:0.0:1787906939.103578:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad789 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6e9 expref: 17 pid: 5832 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906939.103646:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:0.0:1787906939.103656:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+17:2346:x1874755972017664:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906939.103674:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906939.103682:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad789 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6e9 expref: 17 pid: 5832 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.103694:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad789 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6e9 expref: 17 pid: 5832 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.103719:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cad789 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef6e9 expref: 17 pid: 5832 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.103737:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca400) 00010000:00010000:0.0:1787906939.103742:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.103753:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.103762:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.103787:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906939.103866:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+16:2346:x1874755972017664:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 210us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906939.103873:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00010000:00010000:3.0:1787906939.103929:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.103937:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.103949:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.103956:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.103962:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.103968:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906939.103973:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.103980:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.103995:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca400) 00010000:00010000:3.0:1787906939.103998:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906939.104002:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.104008:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad846 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.104020:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad838 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.104027:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad838 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.104032:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad838 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.104037:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211e00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906939.104040:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad838 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.104047:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad838 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.104054:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069ca400) 00010000:00010000:3.0:1787906939.104056:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787906939.104058:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad838 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.104065:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad838 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906939.104290:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+15:10463:x1874755972017408:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 51237us (52373us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1787906939.104298:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 83 00000020:00080000:3.0:1787906939.104302:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787906939.105700:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787906939.105717:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787906939.105756:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787906939.105762:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787906939.118389:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906939.121875:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972017920 00000100:00100000:3.0:1787906939.121888:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972017920 00000100:00100000:3.0:1787906939.121995:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:3.0:1787906939.122006:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+15:10463:x1874755972017920:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787906939.122929:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787906939.123024:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787906939.123070:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad84d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.123087:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad84d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.123098:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad84d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.123118:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad84d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.123126:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad84d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.123133:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad84d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906939.123153:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787906939.123317:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787906939.123324:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad84d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.123332:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787906939.123336:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad84d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.123344:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad84d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.123357:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa5069ca400) 00010000:00010000:0.0:1787906939.123360:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787906939.123363:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad84d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.123369:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad84d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906939.123387:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906939.123388:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906939.123390:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906939.123575:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+17:10463:x1874755972017920:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 1567us (5192us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787906939.123585:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000020:00080000:3.0:1787906939.123599:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787906939.557084:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906939.915462:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906939.915512:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906939.915549:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906939.915685:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972018432 00000100:00100000:0.0:1787906939.915697:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972018432 00000100:00100000:3.0:1787906939.915948:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906939.915972:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972018176 00000100:00100000:1.0:1787906939.915987:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972018176 00000100:00100000:3.0:1787906939.916005:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906939.916042:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972018560 00000100:00100000:1.0:1787906939.916046:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972018560 00000100:00100000:3.0:1787906939.916061:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972018304 00000100:00100000:3.0:1787906939.916067:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972018304 00000100:00100000:1.0:1787906939.916086:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 152 00000100:00100000:1.0:1787906939.916099:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+17:2345:x1874755972018176:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906939.916169:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:3.0:1787906939.916179:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2345:x1874755972018304:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906939.916197:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+17:2345:x1874755972018176:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 100us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906939.916206:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 152 00000100:00100000:3.0:1787906939.916215:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2345:x1874755972018304:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 37us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906939.916233:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 153 00000100:00100000:1.0:1787906939.916240:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755972018560:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906939.916266:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755972018560:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906939.916272:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 153 00000100:00080000:1.0:1787906939.916288:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787906939.916303:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906939.916329:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:0.0:1787906939.919640:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:0.0:1787906939.919656:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755972018432:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906939.920430:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755972018432:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 775us (4912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906939.920446:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:2.0:1787906939.922743:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972018048 00000100:00100000:2.0:1787906939.922759:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972018048 00000100:00100000:2.0:1787906939.922836:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 296 00000100:00100000:2.0:1787906939.922845:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755972018048:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906939.922917:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755972018048:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 73us (7367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906939.922936:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 296 00010000:00010000:0.0:1787906940.578182:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906940.578229:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000356224:0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.578316:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906940.578372:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874756000356736:0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.578399:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906940.578425:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787906940.578430:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000356352:0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.578449:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906940.578464:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000356864:0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.578485:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906940.578513:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000356480:0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.578538:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906940.578580:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787906940.578586:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000356608:0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.578608:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906940.578641:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000356224 00000100:00100000:0.0:1787906940.578649:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000356224 00000100:00100000:0.0:1787906940.578703:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787906940.578714:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3301:x1874756000356224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.578778:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3301:x1874756000356224:12345-0@lo:400:kworker.0 Request processed in 66us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906940.578785:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787906940.578839:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000356864 00000100:00100000:0.0:1787906940.578844:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000356864 00000100:00100000:0.0:1787906940.578889:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000356608 00000100:00100000:0.0:1787906940.578893:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000356608 00000100:00100000:0.0:1787906940.578914:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787906940.578920:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1874756000356864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.578967:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1874756000356864:12345-0@lo:400:kworker.0 Request processed in 48us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906940.578973:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787906940.578985:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787906940.578991:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1874756000356608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.579023:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1874756000356608:12345-0@lo:400:kworker.0 Request processed in 32us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906940.579029:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787906940.579048:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000356736 00000100:00100000:0.0:1787906940.579052:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000356736 00000100:00100000:0.0:1787906940.579078:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000356352 00000100:00100000:0.0:1787906940.579082:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000356352 00000100:00100000:0.0:1787906940.579093:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000356480 00000100:00100000:0.0:1787906940.579095:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000356480 00000100:00100000:0.0:1787906940.579111:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787906940.579117:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874756000356736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.579148:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874756000356736:12345-0@lo:400:kworker.0 Request processed in 32us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906940.579154:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787906940.579166:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787906940.579171:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000356352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.579197:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000356352:12345-0@lo:400:kworker.0 Request processed in 25us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906940.579212:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787906940.579223:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787906940.579230:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000356480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.579259:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000356480:12345-0@lo:400:kworker.0 Request processed in 30us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906940.579265:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787906940.579314:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000356608:0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.579327:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000356480:0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.579358:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000356352:0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.579370:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000356864:0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.579377:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000356224:0@lo:400:kworker.0 00000100:00100000:0.0:1787906940.579386:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874756000356736:0@lo:400:kworker.0 00000100:00080000:1.0:1787906940.582191:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787906940.582200:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787906940.582203:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787906940.669708:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1787906941.091313:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000356992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787906941.091393:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906941.091581:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000356992 00000100:00100000:0.0:1787906941.091590:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000356992 00000100:00100000:0.0:1787906941.091666:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787906941.091676:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874756000356992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787906941.091714:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906941.091763:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874756000356992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906941.091769:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787906941.091870:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000356992:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787906941.292533:0:12062:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787906941.292543:0:12062:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787906941.292605:0:12062:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787906941.292612:0:12062:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787906941.600740:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906941.657281:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906941.657359:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972018816 00000100:00100000:0.0:1787906941.657384:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972018816 00000100:00100000:0.0:1787906941.657465:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:0.0:1787906941.657476:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+17:10482:x1874755972018816:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1787906941.657498:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906941.657551:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad854 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef721 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.657844:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad85b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.657859:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad85b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.657871:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad85b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906941.657882:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787906941.658060:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad854 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef721 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.658079:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad85b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef721 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.658088:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:0.0:1787906941.658091:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787906941.658095:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8e000, rc 0) 00000100:00100000:0.0:1787906941.658154:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+19:10482:x1874755972018816:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 680us (883us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787906941.658161:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00080000:2.0:1787906941.658344:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906941.670366:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906941.670563:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972018944 00000100:00100000:0.0:1787906941.670574:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972018944 00000100:00100000:0.0:1787906941.670639:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:0.0:1787906941.670651:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+19:10482:x1874755972018944:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:0.0:1787906941.670740:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad869 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.670758:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad869 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.670770:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad869 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.670837:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.670845:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.670852:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671171:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671179:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671186:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787906941.671228:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671249:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad869 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671255:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad869 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671262:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad869 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671268:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906941.671273:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad869 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671280:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad869 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671292:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:0.0:1787906941.671295:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906941.671299:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad869 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671305:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad869 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671320:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671325:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad870 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671330:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671342:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906941.671345:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671351:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad870 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671360:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa510860600) 00010000:00010000:0.0:1787906941.671362:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906941.671365:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad870 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671371:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad870 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671385:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671390:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad877 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671395:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671400:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8ec00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906941.671403:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671408:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad877 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671426:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa510860a00) 00010000:00010000:0.0:1787906941.671428:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906941.671431:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad877 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.671437:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad877 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906941.671518:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+19:10482:x1874755972018944:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 867us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906941.671528:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:0.0:1787906941.774304:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906941.774534:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972019200 00000100:00100000:3.0:1787906941.774619:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972019200 00000100:00100000:3.0:1787906941.774757:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:3.0:1787906941.774770:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+19:10485:x1874755972019200:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906941.774793:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906941.775014:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad87e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef728 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.775104:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad885 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.775131:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.775145:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.775161:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad88c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.775168:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad88c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.775179:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad88c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.775779:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.775791:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.775799:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906941.776264:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787906941.776766:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.776778:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad885 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.776786:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad885 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.776793:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906941.776798:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad885 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.776951:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad885 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.776968:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:2.0:1787906941.776972:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906941.776977:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad885 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.776984:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad885 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.777001:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad88c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.777007:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad88c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.777030:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad88c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.777035:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906941.777038:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad88c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.777045:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad88c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.777054:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa5069ca900) 00010000:00010000:2.0:1787906941.777057:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906941.777060:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad88c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.777066:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad88c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.777412:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad87e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef728 expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.777431:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef728 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906941.777439:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:2.0:1787906941.777441:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787906941.777444:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030800, rc 0) 00000100:00100000:2.0:1787906941.777595:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+21:10485:x1874755972019200:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 2826us (3425us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787906941.777614:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:3.0:1787906941.781389:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906941.781714:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972019328 00000100:00100000:0.0:1787906941.781727:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972019328 00000100:00100000:3.0:1787906941.781950:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 87 00000100:00100000:3.0:1787906941.781964:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+21:10485:x1874755972019328:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:3.0:1787906941.782044:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad8a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.782081:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.782093:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.782122:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.782129:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad8a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.782137:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.782144:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906941.782148:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.782156:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad8a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.782169:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:3.0:1787906941.782185:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787906941.782191:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad8a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.782198:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad8a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906941.782276:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+21:10485:x1874755972019328:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 316us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906941.782291:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 87 00000100:00100000:2.0:1787906941.791332:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906941.791422:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972019584 00000100:00100000:3.0:1787906941.791434:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972019584 00000100:00100000:3.0:1787906941.791494:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:3.0:1787906941.791505:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa529399050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+21:10485:x1874755972019584:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1787906941.791767:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa529399050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+22:10485:x1874755972019584:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 262us (444us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787906941.791775:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:1.0:1787906941.888528:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906941.888679:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972019840 00000100:00100000:0.0:1787906941.888691:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972019840 00000100:00100000:0.0:1787906941.888766:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 88 00000100:00100000:0.0:1787906941.888781:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+22:10006:x1874755972019840:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1787906941.889212:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906941.889235:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad8a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef72f expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.889348:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.889373:0:10853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad893 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef728 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.889407:0:10853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.889447:0:10853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef728 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906941.889462:0:10853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad893 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef728 expref: 23 pid: 5832 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906941.889478:0:10853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000357120:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906941.889646:0:10853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507205840 going to sleep for 11 seconds 00000100:00100000:0.0:1787906941.900082:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906941.900259:0:10853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000357120:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906941.900290:0:10853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906941.900411:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972019968 00000100:00100000:1.0:1787906941.900418:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972019968 00010000:00010000:1.0:1787906941.900455:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad893 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef728 expref: 24 pid: 5832 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906941.900498:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:1.0:1787906941.900508:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+24:2345:x1874755972019968:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906941.900522:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906941.900546:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad893 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef728 expref: 24 pid: 5832 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906941.900560:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef728 expref: 24 pid: 5832 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906941.900583:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cad893 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef728 expref: 24 pid: 5832 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906941.900609:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:1.0:1787906941.900615:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906941.900638:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906941.900646:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906941.900675:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906941.900745:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+23:2345:x1874755972019968:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 238us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906941.900753:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00010000:00010000:3.0:1787906941.900977:0:10853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.900985:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906941.901004:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787906941.901158:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad8a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef72f expref: 24 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.901404:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef72f expref: 23 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.901422:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:3.0:1787906941.901425:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787906941.901437:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f400, rc 0) 00000100:00100000:3.0:1787906941.901469:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+23:10006:x1874755972019840:12345-192.168.204.20@tcp:101:bash.0 Request processed in 12694us (12957us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787906941.901477:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 88 00000100:00100000:0.0:1787906941.909491:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906941.909605:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972020224 00000100:00100000:1.0:1787906941.909616:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972020224 00000100:00100000:1.0:1787906941.909673:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 89 00000100:00100000:1.0:1787906941.909683:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+23:10006:x1874755972020224:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:1.0:1787906941.909986:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad8bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906941.910004:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad8bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906941.910015:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad8bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787906941.910074:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1787906941.910102:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f9eb49a reply state 000000005dea3fae transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad8bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906941.910110:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787906941.910160:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1787906941.910274:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+27:10006:x1874755972020224:12345-192.168.204.20@tcp:36:bash.0 Request processed in 589us (800us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1787906941.910298:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 89 00000020:00080000:1.0:1787906941.910304:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787906941.915548:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad8bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.915570:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad8bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.915578:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad8bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.915584:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906941.915589:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad8bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.915596:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad8bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.915615:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:3.0:1787906941.915619:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906941.915623:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad8bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.915629:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cad8bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906941.917348:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906941.917551:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972020352 00000100:00100000:3.0:1787906941.917561:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972020352 00000100:00100000:3.0:1787906941.917629:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:3.0:1787906941.917641:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+26:10006:x1874755972020352:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1787906941.917677:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906941.917699:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad8c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef736 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.917763:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad8c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef736 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.917777:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad8c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef736 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.917807:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:3.0:1787906941.917832:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787906941.917836:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030200, rc 0) 00000100:00100000:3.0:1787906941.917903:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+27:10006:x1874755972020352:12345-192.168.204.20@tcp:101:bash.0 Request processed in 263us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906941.917910:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:0.0:1787906941.926929:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906941.927765:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972020480 00000100:00100000:3.0:1787906941.927778:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972020480 00000100:00100000:3.0:1787906941.927889:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:3.0:1787906941.927900:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:10006:x1874755972020480:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1787906941.927919:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906941.927941:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cad8cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef73d expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787906941.927970:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a914b79, atime: 0x6a914b77, ctime: 0x6a914b79, blocks: 0xb 00010000:00010000:3.0:1787906941.927994:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=380s v=(0 0) 00010000:00010000:3.0:1787906941.927999:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906941.928025:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cad8cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef73d expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.928048:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cad8cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef73d expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906941.928062:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030800, rc 0) 00000100:00100000:3.0:1787906941.928132:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:10006:x1874755972020480:12345-192.168.204.20@tcp:101:bash.0 Request processed in 235us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906941.928139:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00080000:2.0:1787906941.929983:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787906941.943978:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906941.944214:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972020608 00000100:00100000:0.0:1787906941.944230:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972020608 00002000:00010000:0.0:1787906941.944290:0:6678:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787906941.944296:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa53f7ed180 with x1874755972020608 ext(0->18446744073709551615) 00002000:00010000:0.0:1787906941.944313:0:6678:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa53f7ed180. 00000100:00100000:0.0:1787906941.944349:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:0.0:1787906941.944361:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972020608:12345-192.168.204.20@tcp:10:bash.0 00002000:00010000:0.0:1787906941.944746:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787906941.944751:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787906937 -> 1787906941 00002000:00010000:0.0:1787906941.944753:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787906935 -> 1787906935 00002000:00010000:0.0:1787906941.944755:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787906937 -> 1787906941 00002000:00010000:0.0:1787906941.944772:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787906941.945014:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972020608:12345-192.168.204.20@tcp:10:bash.0 Request processed in 653us (1044us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787906941.945023:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00002000:00010000:0.0:1787906941.945027:0:6678:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787906941.945030:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa53f7ed180 with x1874755972020608 ext(0->18446744073709551615) 00002000:00010000:0.0:1787906941.945036:0:6678:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa53f7ed180. 00000100:00100000:1.0:1787906942.122140:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906942.124122:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972020736 00000100:00100000:3.0:1787906942.124142:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972020736 00000100:00100000:3.0:1787906942.124365:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:3.0:1787906942.124378:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+27:10499:x1874755972020736:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:3.0:1787906942.124486:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.124510:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.124525:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.124559:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.124575:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.124582:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.125004:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad8e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.125015:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.125024:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787906942.125086:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.125098:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.125106:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.125114:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.125120:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906942.125125:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.125132:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.125145:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:3.0:1787906942.125148:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906942.125153:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.125594:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.125619:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.125627:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.125633:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.125638:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906942.125641:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.126124:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.126135:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa5069ca900) 00010000:00010000:3.0:1787906942.126138:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906942.126142:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.126148:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.126165:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.126549:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad8e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.126569:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad8e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.126574:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906942.126578:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad8e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.126585:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad8e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.126594:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:3.0:1787906942.126597:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906942.126599:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad8e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.126605:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad8e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906942.127029:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+27:10499:x1874755972020736:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 2647us (4893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906942.127041:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:1.0:1787906942.188198:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906942.188301:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972020992 00000100:00100000:3.0:1787906942.188314:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972020992 00000100:00100000:3.0:1787906942.188385:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 92 00000100:00100000:3.0:1787906942.188408:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+27:10502:x1874755972020992:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906942.188433:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906942.188457:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad8e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef744 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.188584:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.188602:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.188614:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.188631:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.188639:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.188647:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.189418:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad8fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.189430:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.189440:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906942.189452:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787906942.189556:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.189563:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.189578:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.189584:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906942.189590:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.189597:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.189609:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:3.0:1787906942.189612:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906942.189616:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.189622:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cad8ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.189634:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.189640:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.189993:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.189999:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906942.190002:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.190020:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.190030:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa5069ca900) 00010000:00010000:3.0:1787906942.190032:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906942.190034:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.190040:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cad8f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.191608:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cad8e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef744 expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.191639:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad8fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef744 expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.191669:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:2.0:1787906942.191672:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787906942.191674:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511995400, rc 0) 00000100:00100000:2.0:1787906942.191766:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+29:10502:x1874755972020992:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 3369us (3577us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787906942.191776:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 92 00000100:00100000:3.0:1787906942.196316:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906942.196860:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972021120 00000100:00100000:0.0:1787906942.196871:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972021120 00000100:00100000:0.0:1787906942.196926:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 93 00000100:00100000:0.0:1787906942.196937:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+29:10502:x1874755972021120:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:0.0:1787906942.197011:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.197032:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef72f expref: 29 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.197042:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.197085:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef72f expref: 29 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.197101:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef72f expref: 29 pid: 10853 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906942.197115:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874756000357248:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906942.197213:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507205780 going to sleep for 11 seconds 00000100:00100000:0.0:1787906942.206980:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906942.207718:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972021376 00000100:00100000:1.0:1787906942.207732:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972021376 00000100:00100000:1.0:1787906942.207796:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:1.0:1787906942.207807:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+30:5586:x1874755972021376:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787906942.208051:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874756000357248:192.168.204.20@tcp:104: 00010000:00010000:2.0:1787906942.208083:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906942.208175:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+31:5586:x1874755972021376:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 369us (1203us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787906942.208182:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:2.0:1787906942.212890:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906942.213108:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972021504 00000100:00100000:0.0:1787906942.213124:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972021504 00010000:00010000:0.0:1787906942.213187:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef72f expref: 31 pid: 10853 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906942.213242:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:0.0:1787906942.213254:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b048000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+31:2345:x1874755972021504:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906942.213274:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906942.213283:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef72f expref: 31 pid: 10853 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.213299:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef72f expref: 31 pid: 10853 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.213333:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad8af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef72f expref: 31 pid: 10853 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.213359:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:0.0:1787906942.213364:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.213376:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.213384:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.213419:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906942.213528:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b048000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+30:2345:x1874755972021504:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 275us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906942.213546:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00010000:00010000:2.0:1787906942.213616:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.213625:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.213686:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.213702:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.213709:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.213715:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906942.213720:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.213728:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.213738:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:2.0:1787906942.213741:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787906942.213744:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.213749:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad90a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906942.213795:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+29:10502:x1874755972021120:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 16859us (17490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906942.213804:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 93 00000100:00100000:0.0:1787906942.222312:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906942.222427:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972021760 00000100:00100000:1.0:1787906942.222438:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972021760 00000100:00100000:1.0:1787906942.222549:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:1.0:1787906942.222561:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+29:10502:x1874755972021760:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1787906942.222804:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+30:10502:x1874755972021760:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 245us (502us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787906942.222845:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:3.0:1787906942.307881:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906942.308157:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972022016 00000100:00100000:0.0:1787906942.308170:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972022016 00000100:00100000:0.0:1787906942.308371:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:0.0:1787906942.308384:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+30:10513:x1874755972022016:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:0.0:1787906942.308428:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906942.308452:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad911 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef74b expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.308549:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad918 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.308565:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad918 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.308578:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad918 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.308593:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad91f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.308600:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad91f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.308607:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad91f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.308991:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cad926 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309152:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cad926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309162:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cad926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906942.309185:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1787906942.309309:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad918 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309317:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad918 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309324:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad918 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309330:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906942.309335:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad918 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309342:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad918 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309356:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:0.0:1787906942.309359:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906942.309364:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad918 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309370:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad918 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309387:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad91f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309445:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad91f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309451:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad91f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309456:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906942.309459:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad91f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309465:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad91f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309473:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa510860a00) 00010000:00010000:0.0:1787906942.309476:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906942.309479:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad91f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309485:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cad91f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309546:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cad911 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef74b expref: 33 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309560:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cad926 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef74b expref: 32 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.309567:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:0.0:1787906942.309569:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906942.309578:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8e600, rc 0) 00000100:00100000:0.0:1787906942.309649:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+32:10513:x1874755972022016:12345-192.168.204.20@tcp:101:cat.0 Request processed in 1268us (1780us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787906942.309657:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:2.0:1787906942.315847:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906942.317263:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972022272 00000100:00100000:3.0:1787906942.317277:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972022272 00000100:00100000:3.0:1787906942.317352:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1787906942.317364:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+32:10513:x1874755972022272:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:3.0:1787906942.317660:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+33:10513:x1874755972022272:12345-192.168.204.20@tcp:35:cat.0 Request processed in 297us (1855us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787906942.317668:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1787906942.372948:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906942.373536:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972022528 00000100:00100000:1.0:1787906942.373549:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972022528 00000100:00100000:1.0:1787906942.374741:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00100000:1.0:1787906942.374758:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+33:10514:x1874755972022528:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:1.0:1787906942.374841:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787906942.374883:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cad926 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef74b expref: 33 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.374909:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cad8fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef744 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.374923:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cad8c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef736 expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.374934:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:1.0:1787906942.374945:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787906942.374985:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad934 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.375000:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad934 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.375011:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad934 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.375026:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad93b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.375034:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad93b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.375041:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad93b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.375370:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad942 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.375389:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad942 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.375396:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad942 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787906942.381415:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1787906942.381438:0:5830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 380653624795ns, next at 381653619682ns, rc = 0 00010000:00010000:1.0:1787906942.382834:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad949 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.382869:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.382882:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.382894:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad949 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.382900:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad949 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.382907:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad949 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.383075:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787906942.383102:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad942 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.383109:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad942 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.383129:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad942 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.383135:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906942.383140:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad942 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.383147:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad942 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.383159:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa518965600) 00010000:00010000:1.0:1787906942.383173:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787906942.383178:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad942 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.383184:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cad942 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.383209:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad934 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.383215:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad934 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.383222:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad934 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.383227:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906942.383230:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad934 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.383244:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad934 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.383253:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:1.0:1787906942.383255:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906942.383258:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad934 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906942.383263:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cad934 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787906942.383272:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e04e235 reply state 000000008a23f93a transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad93b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906942.383282:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787906942.383395:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+32:10514:x1874755972022528:12345-192.168.204.20@tcp:36:rm.0 Request processed in 8637us (10450us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787906942.383406:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 95 00010000:00010000:3.0:1787906942.388212:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787906942.388228:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad949 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.388241:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211e00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787906942.388246:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad949 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.388279:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad949 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.388300:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa518965600) 00010000:00010000:3.0:1787906942.388303:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787906942.388307:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad949 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.388314:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad949 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.388336:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906942.388338:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906942.388340:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906942.391190:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad93b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.391208:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad93b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.391236:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad93b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.391242:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906942.391248:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad93b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.391255:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad93b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.391275:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa518965800) 00010000:00010000:2.0:1787906942.391278:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906942.391283:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad93b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.391289:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad93b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906942.496960:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906942.497408:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972022784 00000100:00100000:2.0:1787906942.497421:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972022784 00000100:00100000:2.0:1787906942.497473:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 96 00000100:00100000:2.0:1787906942.497484:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+31:10520:x1874755972022784:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1787906942.497511:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906942.497546:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cad950 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef752 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.497703:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad957 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.497738:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad957 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.497750:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad957 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.497766:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad95e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.497772:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad95e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.497778:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad95e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787906942.499844:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787906942.500909:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad965 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.500931:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.500943:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.500999:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad957 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.501006:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad957 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.501013:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad957 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.501746:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906942.501753:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad957 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.501761:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad957 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.501777:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:2.0:1787906942.501781:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906942.501786:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad957 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.501793:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad957 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787906942.501810:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b631038a reply state 00000000367f67d3 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad95e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906942.501880:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787906942.501960:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cad950 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef752 expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.501980:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef752 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.501990:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:2.0:1787906942.501992:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787906942.501995:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96000, rc 0) 00000100:00100000:2.0:1787906942.505467:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+34:10520:x1874755972022784:12345-192.168.204.20@tcp:101:bash.0 Request processed in 7968us (8511us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787906942.505500:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 96 00010000:00010000:0.0:1787906942.509886:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad95e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.509905:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad95e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.509913:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad95e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.509919:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906942.509924:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad95e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.509932:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad95e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.509950:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa5069aab00) 00010000:00010000:0.0:1787906942.509953:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906942.509958:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad95e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.509964:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cad95e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906942.515484:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906942.516355:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972022912 00000100:00100000:0.0:1787906942.516366:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972022912 00000100:00100000:0.0:1787906942.516452:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:0.0:1787906942.516464:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2345:x1874755972022912:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1787906942.516498:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906942.516520:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad973 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef759 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787906942.516560:0:8459:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787906942.516583:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1787906942.516589:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787906942.516599:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad973 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef759 expref: 6 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.516619:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad973 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef759 expref: 6 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.516633:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f800, rc 0) 00000100:00100000:0.0:1787906942.516694:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755972022912:12345-192.168.204.20@tcp:101:bash.0 Request processed in 233us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906942.516702:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00080000:2.0:1787906942.518085:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787906942.530389:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906942.530683:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972023040 00000100:00100000:0.0:1787906942.530693:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972023040 00000100:00100000:0.0:1787906942.530761:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:0.0:1787906942.530772:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:10520:x1874755972023040:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1787906942.530789:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906942.530809:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef760 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.530883:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad973 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef759 expref: 7 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.530908:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787906942.530912:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787906942.530918:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.530962:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad973 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef759 expref: 7 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.530975:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad973 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef759 expref: 7 pid: 8459 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906942.530990:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874756000357376:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906942.531087:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507205600 going to sleep for 11 seconds 00000100:00100000:1.0:1787906942.538106:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906942.538271:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972023168 00000100:00100000:2.0:1787906942.538281:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972023168 00010000:00010000:2.0:1787906942.538328:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad973 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef759 expref: 8 pid: 8459 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906942.538374:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:2.0:1787906942.538384:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510227450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972023168:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906942.538399:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906942.538421:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad973 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef759 expref: 8 pid: 8459 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.538436:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad973 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef759 expref: 8 pid: 8459 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.538463:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787906942.538468:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787906942.538477:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.538488:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.538537:0:8506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906942.538567:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b049880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8506:1874756000357504:192.168.204.20@tcp:105: 00000100:00100000:2.0:1787906942.538646:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa518610a80 going to sleep for 11 seconds 00010000:00010000:0.0:1787906942.539569:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad973 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef759 expref: 8 pid: 8459 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906942.539590:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874756000357376:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906942.539613:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.539626:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8e200, rc 0) 00000100:00100000:0.0:1787906942.539681:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:10520:x1874755972023040:12345-192.168.204.20@tcp:101:bash.0 Request processed in 8911us (9305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906942.539701:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:2.0:1787906942.543206:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b049880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8506:1874756000357504:192.168.204.20@tcp:105: 00010000:00010000:2.0:1787906942.543241:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906942.543476:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510227450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755972023168:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 5091us (5379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906942.543488:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:1.0:1787906942.553430:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906942.553650:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972023424 00000100:00100000:3.0:1787906942.553660:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972023424 00000100:00100000:3.0:1787906942.553712:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:3.0:1787906942.553721:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+33:10520:x1874755972023424:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:3.0:1787906942.554337:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+34:10520:x1874755972023424:12345-192.168.204.20@tcp:35:bash.0 Request processed in 613us (912us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787906942.554346:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00010000:00010000:0.0:1787906942.624107:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906942.902941:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906942.903107:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972023552 00000100:00100000:2.0:1787906942.903118:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972023552 00000100:00100000:2.0:1787906942.903186:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:2.0:1787906942.903196:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+34:10536:x1874755972023552:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906942.903221:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906942.903242:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cad981 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef767 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.903308:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad988 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.903322:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.903335:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906942.903411:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787906942.903415:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906942.903456:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.903482:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cad981 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef767 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.903501:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef767 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.903510:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:2.0:1787906942.903513:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787906942.903526:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97800, rc 0) 00000100:00100000:2.0:1787906942.903590:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+35:10536:x1874755972023552:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 396us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906942.903597:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:1.0:1787906942.912311:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906942.913018:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972023808 00000100:00100000:0.0:1787906942.913034:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972023808 00000100:00100000:0.0:1787906942.913107:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 98 00000100:00100000:0.0:1787906942.913118:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+35:10536:x1874755972023808:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1787906942.913138:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906942.913171:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad98f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef76e expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.913286:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.913301:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.913314:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906942.913325:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787906942.913487:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad98f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef76e expref: 38 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.913510:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef76e expref: 37 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.913529:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:0.0:1787906942.913532:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906942.913555:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f200, rc 0) 00000100:00100000:0.0:1787906942.913647:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+37:10536:x1874755972023808:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 531us (1351us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787906942.913656:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 98 00000100:00100000:3.0:1787906942.918332:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906942.918478:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972023936 00000100:00100000:0.0:1787906942.918488:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972023936 00000100:00100000:0.0:1787906942.918562:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:0.0:1787906942.918572:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+37:2346:x1874755972023936:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906942.918586:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906942.918611:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad996 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef76e expref: 37 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.918631:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:0.0:1787906942.918636:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906942.918753:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+36:2346:x1874755972023936:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 182us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906942.918761:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:2.0:1787906942.928351:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906942.930997:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972024192 00000100:00100000:0.0:1787906942.931013:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972024192 00000100:00100000:0.0:1787906942.931082:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:0.0:1787906942.931093:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+36:10536:x1874755972024192:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1787906942.931118:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906942.931141:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad9a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef775 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.931370:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad9ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.933564:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad9ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.933580:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad9ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906942.933605:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787906942.934349:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad9a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef775 expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.934373:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad9ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef775 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.934382:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:0.0:1787906942.934385:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787906942.934389:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f600, rc 0) 00000100:00100000:0.0:1787906942.934472:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+38:10536:x1874755972024192:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 3379us (6140us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787906942.934480:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:2.0:1787906942.943503:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906942.943584:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972024320 00000100:00100000:0.0:1787906942.943594:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972024320 00000100:00100000:0.0:1787906942.943660:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:0.0:1787906942.943672:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755972024320:12345-192.168.204.20@tcp:1:lfs.0 00010000:00010000:0.0:1787906942.943721:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad9b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.943742:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 6 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.943760:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787906942.943765:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787906942.943770:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad9b9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.943806:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 6 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.943869:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 6 pid: 6673 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906942.943886:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8459:1874756000357632:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906942.943973:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507205600 going to sleep for 11 seconds 00000100:00100000:1.0:1787906942.949733:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906942.949908:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972024448 00000100:00100000:2.0:1787906942.949918:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972024448 00002000:00100000:2.0:1787906942.949968:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8aa507ee6d80 x1874755972024448/t0(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:513/0 lens 504/0 e 0 to 0 dl 1787906953 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787906942.949979:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa507ee6d80 with x1874755972024448 ext(0->8) 00010000:00010000:2.0:1787906942.949989:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 7 pid: 6673 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.950005:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 7 pid: 6673 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787906942.950468:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8aa507ee6d80 00000100:00100000:2.0:1787906942.950510:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:2.0:1787906942.950531:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972024448:12345-192.168.204.20@tcp:4:lfs.0 00000100:00100000:0.0:1787906942.954992:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8459:1874756000357632:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906942.955029:0:8459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad9b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906942.956591:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2345:x1874755972024448:12345-192.168.204.20@tcp:4:lfs.0 Request processed in 6051us (6857us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787906942.956607:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00002000:00100000:2.0:1787906942.957911:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8aa507ee6d80 x1874755972024448/t4294967302(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:513/0 lens 504/448 e 0 to 0 dl 1787906953 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787906942.957929:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa507ee6d80 with x1874755972024448 ext(0->8) 00010000:00010000:2.0:1787906942.957944:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 9 pid: 6673 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.957960:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 9 pid: 6673 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787906942.957967:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8aa507ee6d80 00000100:00100000:1.0:1787906942.963122:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906942.963302:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972024576 00000100:00100000:3.0:1787906942.963314:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972024576 00010000:00010000:3.0:1787906942.963356:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 9 pid: 6673 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906942.963429:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:3.0:1787906942.963441:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2346:x1874755972024576:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787906942.963456:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787906942.963479:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787906942.963483:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787906942 00002000:00010000:3.0:1787906942.963485:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787906942 00002000:00010000:3.0:1787906942.963487:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787906942 00010000:00010000:3.0:1787906942.963494:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 9 pid: 6673 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.963508:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 9 pid: 6673 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.963544:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009709e2da/0x72bb6cf063cad97a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef760 expref: 9 pid: 6673 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.963564:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787906942.963568:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787906942.963574:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad9b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.963585:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad9b9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906942.963621:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906942.963751:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972024576:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 311us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906942.963759:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00010000:00010000:0.0:1787906942.964105:0:8459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad9b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.964116:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad9b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.964141:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad9b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.964166:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad9b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.964175:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad9b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.964182:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f800 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787906942.964187:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad9b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.964196:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad9b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.964207:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad9b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.964215:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cad9b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906942.964266:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2343:x1874755972024320:12345-192.168.204.20@tcp:1:lfs.0 Request processed in 20596us (20774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906942.964275:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:1.0:1787906942.974701:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906942.974888:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972024832 00000100:00100000:0.0:1787906942.974898:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972024832 00000100:00100000:0.0:1787906942.974953:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:0.0:1787906942.974977:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa529398850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+38:10536:x1874755972024832:12345-192.168.204.20@tcp:35:lfs.0 00000004:00010000:0.0:1787906942.975052:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad9ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef775 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787906942.975507:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787906942.975565:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787906942.976442:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787906942.976508:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.976535:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad965 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef752 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.976544:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.976581:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef752 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.976597:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad965 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef752 expref: 42 pid: 5832 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906942.976612:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1874756000357760:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906942.976694:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507205cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787906942.982974:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906942.983180:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972024960 00000100:00100000:2.0:1787906942.983190:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972024960 00010000:00010000:2.0:1787906942.983232:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad965 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef752 expref: 43 pid: 5832 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906942.983276:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:2.0:1787906942.983287:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+43:2346:x1874755972024960:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906942.983322:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906942.983330:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad965 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef752 expref: 43 pid: 5832 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.983343:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad965 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef752 expref: 43 pid: 5832 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.983362:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:2.0:1787906942.983368:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.983377:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.983385:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906942.983403:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906942.983463:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+43:2346:x1874755972024960:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 177us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906942.983470:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00010000:00010000:0.0:1787906942.984607:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cad965 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef752 expref: 42 pid: 5832 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906942.984629:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1874756000357760:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906942.984664:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.984673:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.984679:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787906942.984805:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787906942.985076:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1787906942.985256:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1874756000357888:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787906942.985376:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906942.985567:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507205780 going to sleep for 11 seconds 00000100:00100000:1.0:1787906942.985862:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000357888 00000100:00100000:1.0:1787906942.985870:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000357888 00000100:00100000:1.0:1787906942.985933:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787906942.985952:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874756000357888:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787906942.986044:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874756000357888:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 94us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906942.986052:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787906942.986300:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906942.986390:0:5834:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1787906942.986397:0:5834:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1787906942.986416:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa53f7ed500, transno 4294967301 00000100:00100000:0.0:1787906942.986426:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1874756000357888:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787906942.987291:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1787906942.987571:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1874756000358016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787906942.987624:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906942.987692:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507205cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787906942.988800:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000358016 00000100:00100000:1.0:1787906942.988993:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000358016 00000100:00100000:1.0:1787906942.989148:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787906942.989169:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874756000358016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787906942.989438:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1874756000358016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 271us (1812us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787906942.989447:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787906942.989538:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a0a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1874756000358016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787906942.989612:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787906942.989662:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.989674:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.989697:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.989704:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906942.989709:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.989718:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.989735:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:0.0:1787906942.989739:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787906942.989744:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906942.989749:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787906942.990018:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787906942.990129:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1787906942.990141:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381262327478ns, next at 382262325713ns, rc = 0 00000001:00080000:0.0:1787906942.990147:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787906942.990180:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:0.0:1787906942.990183:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787906942.990190:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad9ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef775 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906942.990288:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa529398850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+45:10536:x1874755972024832:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 15313us (15603us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787906942.990307:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000020:00080000:0.0:1787906942.990311:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787906942.996333:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906942.996798:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972025088 00000100:00100000:0.0:1787906942.996808:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972025088 00000100:00100000:2.0:1787906943.001025:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:2.0:1787906943.001351:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+45:10536:x1874755972025088:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906943.001387:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906943.001412:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad9c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef77c expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.001499:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad9c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef77c expref: 46 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.001513:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad9c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef77c expref: 46 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.001543:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:2.0:1787906943.001546:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787906943.001550:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97a00, rc 0) 00000100:00100000:2.0:1787906943.001620:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+46:10536:x1874755972025088:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 292us (5296us total) trans 0 rc 0/0 00000100:00080000:1.0:1787906943.001714:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906943.001797:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:2.0:1787906943.008565:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906943.008659:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972025344 00000100:00100000:3.0:1787906943.008670:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972025344 00000100:00100000:3.0:1787906943.008727:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:3.0:1787906943.008738:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+46:10536:x1874755972025344:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1787906943.009012:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+47:10536:x1874755972025344:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 275us (459us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787906943.009020:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:3.0:1787906943.186604:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906943.186779:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972025472 00000100:00100000:1.0:1787906943.186791:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972025472 00000100:00100000:1.0:1787906943.186883:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00100000:1.0:1787906943.186894:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+47:10546:x1874755972025472:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:1.0:1787906943.186974:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad9ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.186991:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad9ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187003:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad9ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187016:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad9d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187023:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad9d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187058:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad9d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187174:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad9dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187183:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad9dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187190:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad9dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787906943.187231:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad9dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187243:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad9ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187249:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad9ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187255:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad9ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187260:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906943.187265:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad9ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187272:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad9ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187285:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:1.0:1787906943.187294:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906943.187300:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad9ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187307:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cad9ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187321:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad9d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187327:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad9d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187333:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187337:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211e00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906943.187340:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187345:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad9d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187351:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa518965d00) 00010000:00010000:1.0:1787906943.187353:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906943.187356:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad9d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187374:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cad9d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187388:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad9dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187398:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad9dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187403:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad9dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187408:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906943.187411:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad9dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187416:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad9dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187423:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:1.0:1787906943.187425:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906943.187428:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad9dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.187432:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cad9dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906943.187520:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+47:10546:x1874755972025472:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 619us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906943.187529:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00100000:2.0:1787906943.263055:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906943.263192:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972025728 00000100:00100000:0.0:1787906943.263206:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972025728 00000100:00100000:0.0:1787906943.263285:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 102 00000100:00100000:0.0:1787906943.263295:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+47:10549:x1874755972025728:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1787906943.263318:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906943.263339:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad9e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef783 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263440:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263457:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263468:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263482:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad9f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263491:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263498:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263681:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad9f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263690:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263697:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906943.263706:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787906943.263796:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263803:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263855:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263862:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906943.263867:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263873:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263886:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:0.0:1787906943.263888:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906943.263892:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263908:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cad9ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263926:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263932:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad9f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263937:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263941:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8ec00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906943.263945:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263950:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad9f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263959:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa510860a00) 00010000:00010000:0.0:1787906943.263961:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906943.263963:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad9f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.263969:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cad9f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.264011:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cad9e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef783 expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.264024:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad9f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef783 expref: 49 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.264038:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:0.0:1787906943.264040:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906943.264043:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f200, rc 0) 00000100:00100000:0.0:1787906943.264111:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+49:10549:x1874755972025728:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 816us (1072us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1787906943.264119:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 102 00000100:00100000:2.0:1787906943.276652:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906943.276920:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972025856 00000100:00100000:1.0:1787906943.276930:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972025856 00000100:00100000:1.0:1787906943.276992:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 103 00000100:00100000:1.0:1787906943.277003:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+49:10549:x1874755972025856:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1787906943.277071:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.277112:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.277124:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.277161:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.277168:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.277175:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.277181:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906943.277185:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.277192:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.277203:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:1.0:1787906943.277206:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787906943.277211:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.277217:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906943.277293:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+49:10549:x1874755972025856:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 290us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906943.277306:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 103 00000100:00100000:3.0:1787906943.281720:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906943.281872:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972026112 00000100:00100000:0.0:1787906943.281881:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972026112 00000100:00100000:0.0:1787906943.281942:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:0.0:1787906943.281952:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa51032b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+49:10549:x1874755972026112:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1787906943.282243:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa51032b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+50:10549:x1874755972026112:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 291us (531us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787906943.282251:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:2.0:1787906943.443012:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906943.443328:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972026368 00000100:00100000:0.0:1787906943.443339:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972026368 00000100:00100000:0.0:1787906943.443404:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 104 00000100:00100000:0.0:1787906943.443416:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+50:10559:x1874755972026368:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1787906943.443444:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906943.443448:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787906943.443487:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cad988 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef767 expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.443517:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:0.0:1787906943.443523:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787906943.443552:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cada0d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef78a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.443659:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cada14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.443674:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cada14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.443684:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cada14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906943.443697:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787906943.444122:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cada0d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef78a expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.444204:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cada14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef78a expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.444214:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:0.0:1787906943.444216:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906943.444219:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8ec00, rc 0) 00000100:00100000:0.0:1787906943.444329:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+51:10559:x1874755972026368:12345-192.168.204.20@tcp:101:bash.0 Request processed in 915us (1326us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787906943.444337:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 104 00000100:00100000:2.0:1787906943.453697:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906943.453796:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972026624 00000100:00100000:1.0:1787906943.453808:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972026624 00000100:00100000:1.0:1787906943.453913:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 105 00000100:00100000:1.0:1787906943.453923:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+51:10559:x1874755972026624:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:1.0:1787906943.453986:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787906943.454019:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cada14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef78a expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.454054:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f200/0x72bb6cf063cad9f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef783 expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.454066:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:1.0:1787906943.454071:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787906943.454313:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.454328:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.454340:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787906943.454400:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1787906943.454426:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b772beba reply state 00000000c46eebd3 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906943.454437:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787906943.454553:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+52:10559:x1874755972026624:12345-192.168.204.20@tcp:36:bash.0 Request processed in 630us (868us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787906943.454560:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 105 00000020:00080000:1.0:1787906943.454566:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787906943.459759:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.459778:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.459786:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.459792:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906943.459866:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.459875:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.459902:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:2.0:1787906943.459906:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906943.459910:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada22 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.459918:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cada22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906943.468328:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906943.468681:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972026752 00000100:00100000:0.0:1787906943.468692:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972026752 00000100:00100000:0.0:1787906943.468754:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 106 00000100:00100000:0.0:1787906943.468765:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+51:10559:x1874755972026752:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1787906943.468809:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906943.468866:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cada29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef791 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.469074:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cada30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.469089:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cada30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.469100:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cada30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906943.469129:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787906943.469133:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787906943.469163:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cada30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.469190:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cada29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef791 expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.469209:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cada30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef791 expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.469218:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:0.0:1787906943.469221:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906943.469224:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f800, rc 0) 00000100:00100000:0.0:1787906943.469281:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+52:10559:x1874755972026752:12345-192.168.204.20@tcp:101:bash.0 Request processed in 518us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906943.469288:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 106 00000100:00100000:1.0:1787906943.474417:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906943.474637:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972027008 00000100:00100000:0.0:1787906943.474649:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972027008 00000100:00100000:0.0:1787906943.474710:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:0.0:1787906943.474721:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+52:10559:x1874755972027008:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:1.0:1787906943.476318:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+53:10559:x1874755972027008:12345-192.168.204.20@tcp:35:bash.0 Request processed in 1590us (1917us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787906943.476332:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:1.0:1787906943.609382:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906943.609554:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972027136 00000100:00100000:3.0:1787906943.609566:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972027136 00000100:00100000:3.0:1787906943.609648:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 107 00000100:00100000:3.0:1787906943.609659:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+53:10565:x1874755972027136:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906943.609686:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906943.609708:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cada37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef798 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.609787:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cada3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.609801:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cada3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.609842:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cada3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906943.609943:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787906943.609947:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906943.609970:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cada3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.610000:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cada37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef798 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.610019:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cada3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef798 expref: 54 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.610028:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:3.0:1787906943.610031:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787906943.610035:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511995800, rc 0) 00000100:00100000:3.0:1787906943.610101:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+54:10565:x1874755972027136:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 443us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906943.610108:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 107 00000100:00100000:2.0:1787906943.615409:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906943.615535:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972027264 00000100:00100000:0.0:1787906943.615547:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972027264 00000100:00100000:0.0:1787906943.615609:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 108 00000100:00100000:0.0:1787906943.615631:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+54:10565:x1874755972027264:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1787906943.615654:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906943.615679:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cada45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef79f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.615755:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.615773:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.615785:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.615801:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cada53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.615808:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cada53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.615866:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cada53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.615985:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cada5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616016:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cada5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616036:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cada5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906943.616081:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787906943.616085:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787906943.616173:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cada5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616184:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cada5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616194:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616199:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616205:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616211:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906943.616216:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616223:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616235:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:0.0:1787906943.616238:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906943.616252:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616258:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616274:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cada53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616279:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cada53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616284:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cada53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616289:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906943.616292:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cada53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616297:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cada53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616304:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa510860a00) 00010000:00010000:0.0:1787906943.616306:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906943.616309:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cada53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616315:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cada53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616347:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cada45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef79f expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616376:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cada5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef79f expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.616383:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:0.0:1787906943.616385:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906943.616388:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f400, rc 0) 00000100:00100000:0.0:1787906943.616448:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+55:10565:x1874755972027264:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 829us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906943.616455:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 108 00000100:00100000:1.0:1787906943.625458:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906943.626184:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972027392 00000100:00100000:3.0:1787906943.626196:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972027392 00000100:00100000:3.0:1787906943.626271:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1787906943.626283:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+55:2346:x1874755972027392:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787906943.626298:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906943.626322:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cada5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef79f expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.626343:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:3.0:1787906943.626372:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906943.627030:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+54:2346:x1874755972027392:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 747us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906943.627039:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:0.0:1787906943.642764:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906943.646649:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972027648 00000100:00100000:3.0:1787906943.646666:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972027648 00000100:00100000:3.0:1787906943.646733:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 109 00000100:00100000:3.0:1787906943.646745:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+54:10565:x1874755972027648:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906943.646770:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906943.648491:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cada61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef7a6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.648616:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906943.648696:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.648717:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cada30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef791 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.648725:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.648762:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cada30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef791 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.648776:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cada30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef791 expref: 55 pid: 5832 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906943.652861:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510328a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874756000358144:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906943.652991:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a12600 going to sleep for 11 seconds 00000100:00100000:0.0:1787906943.653557:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787906943.653577:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000358272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787906943.653636:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906943.653680:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000358272 00000100:00100000:0.0:1787906943.653687:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000358272 00000100:00100000:0.0:1787906943.653735:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787906943.653743:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874756000358272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787906943.653766:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906943.653858:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874756000358272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906943.653865:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787906943.653916:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000358272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906943.670260:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906943.670300:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972027776 00000100:00100000:2.0:1787906943.670310:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972027776 00010000:00010000:2.0:1787906943.670354:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cada30 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef791 expref: 56 pid: 5832 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906943.670413:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:2.0:1787906943.670425:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+56:2346:x1874755972027776:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906943.670442:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906943.670449:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cada30 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef791 expref: 56 pid: 5832 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.670463:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cada30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef791 expref: 56 pid: 5832 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.670524:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:2.0:1787906943.670531:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.670542:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.670551:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.670573:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906943.670635:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+56:2346:x1874755972027776:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 212us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906943.670642:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00010000:00010000:3.0:1787906943.671121:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cada30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef791 expref: 55 pid: 5832 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906943.671152:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510328a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874756000358144:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906943.671174:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.671183:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.671189:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906943.671208:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787906943.672531:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995000/0x72bb6cf063cada61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7a6 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.672555:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7a6 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.672564:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:3.0:1787906943.672567:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787906943.672570:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511995400, rc 0) 00000100:00100000:3.0:1787906943.672630:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+55:10565:x1874755972027648:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 25887us (35849us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787906943.672640:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 109 00000100:00100000:3.0:1787906943.680039:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906943.680110:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972028032 00000100:00100000:3.0:1787906943.680123:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972028032 00000100:00100000:3.0:1787906943.681992:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:3.0:1787906943.682008:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510328a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+55:10565:x1874755972028032:12345-192.168.204.20@tcp:103:lfs.0 00010000:00010000:3.0:1787906943.682036:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906943.682062:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cad9c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef77c expref: 55 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.682080:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:3.0:1787906943.682085:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906943.682152:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510328a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+54:10565:x1874755972028032:12345-192.168.204.20@tcp:103:lfs.0 Request processed in 148us (2137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906943.682159:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1787906943.687274:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906943.696769:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972028160 00000100:00100000:2.0:1787906943.696800:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972028160 00000100:00100000:2.0:1787906943.696906:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 110 00000100:00100000:2.0:1787906943.696918:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+54:10565:x1874755972028160:12345-192.168.204.20@tcp:58:lfs.0 00010000:00010000:2.0:1787906943.697074:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cada76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.697109:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cada76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.697121:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cada76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787906943.697519:0:10853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787906943.697636:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+54:10565:x1874755972028160:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 718us (10373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906943.697653:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 110 00000100:00100000:2.0:1787906943.702800:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906943.702969:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972028288 00000100:00100000:1.0:1787906943.702984:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972028288 00000100:00100000:1.0:1787906943.703074:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 111 00000100:00100000:1.0:1787906943.703098:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+54:10565:x1874755972028288:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1787906943.703123:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906943.703160:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cada7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef7ad expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.703228:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cada76 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.703238:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cada7d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7ad expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.703262:0:5831:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cada76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.703277:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cada7d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7ad expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.703313:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:1.0:1787906943.703316:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787906943.703321:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cada7d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7ad expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.703329:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508210400, rc 0) 00000100:00100000:1.0:1787906943.703405:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+55:10565:x1874755972028288:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 322us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906943.703412:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 111 00000001:00080000:3.0:1787906943.747692:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967395 is committed 00000004:00080000:3.0:1787906943.747722:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787906943.747747:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa507205780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787906943.747752:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa507c0f100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa507205c00 00000020:00080000:3.0:1787906943.747755:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa507c0f700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa517036800 00000004:00080000:3.0:1787906943.747797:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787906943.747858:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa5361616c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787906943.747862:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa53f7d1500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa536161d80 00000020:00080000:3.0:1787906943.747865:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa53f7d1400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa53b09e800 00000020:00080000:3.0:1787906943.747893:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1787906943.748043:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000358400:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787906943.748125:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906943.748201:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000358400 00000100:00100000:3.0:1787906943.748208:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000358400 00000100:00100000:3.0:1787906943.748260:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787906943.748270:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1874756000358400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787906943.748298:0:6675:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1787906943.748323:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009de80213/0x72bb6cf063cada84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.748346:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cad8cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef73d expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.748354:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787906943.748359:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787906943.748363:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009de80213/0x72bb6cf063cada84 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.748390:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cad8cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef73d expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.748405:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cad8cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef73d expref: 7 pid: 6673 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906943.748416:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510210380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1874756000358528:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906943.748471:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a12600 going to sleep for 11 seconds 00000100:00080000:3.0:1787906943.748484:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:2.0:1787906943.748635:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787906943.748860:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787906943.751085:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787906943.751121:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000358656:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787906943.751209:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906943.751477:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000358656 00000100:00100000:0.0:1787906943.751489:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000358656 00000100:00100000:0.0:1787906943.751577:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787906943.751612:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874756000358656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787906943.751653:0:6674:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1787906943.751696:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a914b7e, atime: 0x6a914b7e, ctime: 0x6a914b7e, blocks: 0x1 00010000:00010000:0.0:1787906943.751704:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de4be4e3/0x72bb6cf063cada8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.751724:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1787906943.751729:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787906943.751736:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de4be4e3/0x72bb6cf063cada8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.751756:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de4be4e3/0x72bb6cf063cada8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.751768:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de4be4e3/0x72bb6cf063cada8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.751778:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de4be4e3/0x72bb6cf063cada8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906943.751797:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787906943.754307:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787906943.754328:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de4be4e3/0x72bb6cf063cada8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.754368:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e800 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787906943.754374:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de4be4e3/0x72bb6cf063cada8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.754387:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de4be4e3/0x72bb6cf063cada8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.754428:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de4be4e3/0x72bb6cf063cada8b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.754437:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de4be4e3/0x72bb6cf063cada8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906943.754486:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906943.754489:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906943.754491:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906943.755800:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906943.755871:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510210380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1874756000358528:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906943.755897:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009de80213/0x72bb6cf063cada84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906943.756273:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972028416 00000100:00100000:2.0:1787906943.756282:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972028416 00010000:00010000:2.0:1787906943.756341:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cad8cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef73d expref: 8 pid: 6673 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906943.756374:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:2.0:1787906943.756385:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510226c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972028416:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906943.756413:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906943.756420:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cad8cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef73d expref: 8 pid: 6673 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.756432:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cad8cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef73d expref: 8 pid: 6673 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.756455:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cad8cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef73d expref: 8 pid: 6673 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.756487:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787906943.756516:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787906943.756522:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009de80213/0x72bb6cf063cada84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.756532:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009de80213/0x72bb6cf063cada84 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.756557:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906943.756613:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510226c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972028416:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 229us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906943.756620:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00010000:00010000:2.0:1787906943.757630:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009de80213/0x72bb6cf063cada84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.757645:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009de80213/0x72bb6cf063cada84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.757655:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009de80213/0x72bb6cf063cada84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.757662:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009de80213/0x72bb6cf063cada84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906943.757677:0:6675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1787906943.758875:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787906943.760068:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787906943.760081:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009de80213/0x72bb6cf063cada84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.760095:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030200 already unused, calling callback (ffffffffc1439230) 00010000:00010000:1.0:1787906943.760100:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009de80213/0x72bb6cf063cada84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.760112:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009de80213/0x72bb6cf063cada84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.760144:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009de80213/0x72bb6cf063cada84 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.760152:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009de80213/0x72bb6cf063cada84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906943.760193:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906943.760196:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906943.760198:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787906943.764114:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa52f3b8700/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787906943.764132:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000358656:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787906943.764452:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1874756000358400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16180us (16323us total) trans 4294967307 rc 0/0 00000004:00080000:0.0:1787906943.764760:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa510329c00/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787906943.764767:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000358400:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787906943.764875:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787906943.764982:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1874756000358656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13203us (13603us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787906943.764991:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000040:00080000:3.0:1787906944.233641:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787906944.233653:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787906944.233711:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787906944.234504:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787906944.234857:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510210380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874756000358784:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787906944.235058:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a12840 going to sleep for 11 seconds 00000100:00100000:3.0:1787906944.264563:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906944.264600:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972028544 00000100:00100000:3.0:1787906944.264610:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972028544 00000100:00100000:3.0:1787906944.264676:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 112 00000100:00100000:3.0:1787906944.264687:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+15:10567:x1874755972028544:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787906944.264720:0:10853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787906944.264843:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+15:10567:x1874755972028544:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 157us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906944.264850:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 112 00000100:00100000:3.0:1787906944.264987:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510210380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874756000358784:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787906944.278315:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906944.283072:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972028672 00000100:00100000:0.0:1787906944.283849:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972028672 00000100:00100000:0.0:1787906944.283919:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 113 00000100:00100000:0.0:1787906944.283930:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+14:10567:x1874755972028672:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787906944.284005:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada92 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.284036:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.284051:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.284786:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cada99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.284800:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cada99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.284833:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cada99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.284859:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadaa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.284868:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadaa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.284875:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadaa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906944.284926:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787906944.284930:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787906944.284945:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadaa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.284957:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.284963:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada92 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.284985:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.284991:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906944.284995:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.285001:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada92 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.285026:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa518965b00) 00010000:00010000:1.0:1787906944.285029:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906944.285034:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.285040:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cada92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.285054:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cada99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.285060:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cada99 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.285074:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cada99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.285959:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906944.285964:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cada99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.285989:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cada99 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.286000:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8aa518965600) 00010000:00010000:1.0:1787906944.286003:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906944.286006:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cada99 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.286024:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cada99 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.286046:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadaa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.286053:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadaa0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.286060:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadaa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.286065:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211e00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906944.286067:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadaa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.286086:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadaa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.286094:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:1.0:1787906944.286096:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906944.286099:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadaa0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.286117:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadaa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906944.286217:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+14:10567:x1874755972028672:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 2284us (7908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906944.286226:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 113 00000100:00100000:3.0:1787906944.291529:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906944.291742:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972028928 00000100:00100000:2.0:1787906944.291752:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972028928 00000100:00100000:2.0:1787906944.291802:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:2.0:1787906944.291827:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+14:10567:x1874755972028928:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787906944.291846:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906944.291864:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadaa7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef7b4 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.291948:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadaae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.291960:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadaae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.291968:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadaae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906944.291976:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787906944.292702:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadaae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.292711:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadaae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.292718:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadaae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.292723:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906944.292727:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadaae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.292746:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadaae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.292758:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:2.0:1787906944.292761:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787906944.292766:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadaae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.292771:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadaae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.293647:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadaa7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7b4 expref: 16 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.293662:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa518965b00) 00010000:00010000:2.0:1787906944.293665:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787906944.293669:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadaa7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7b4 expref: 16 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.293681:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96e00, rc 0) 00000100:00100000:2.0:1787906944.293756:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+15:10567:x1874755972028928:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1945us (2238us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787906944.293766:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:0.0:1787906944.298302:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906944.298351:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972029056 00000100:00100000:2.0:1787906944.298362:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972029056 00000100:00100000:2.0:1787906944.298431:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:2.0:1787906944.298442:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+15:10567:x1874755972029056:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787906944.298529:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787906944.298674:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+15:10567:x1874755972029056:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 234us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906944.298682:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 115 00000001:00080000:0.0:1787906944.300374:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1787906944.300390:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1787906944.300396:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:1.0:1787906944.301756:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906944.301896:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972029312 00000100:00100000:3.0:1787906944.301906:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972029312 00000100:00100000:3.0:1787906944.301961:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:3.0:1787906944.301972:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+15:10567:x1874755972029312:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787906944.301990:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906944.301994:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787906944.302030:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995800/0x72bb6cf063cada3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef798 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.302069:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:3.0:1787906944.302075:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787906944.302089:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cadabc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef7bb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787906944.302774:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787906944.303108:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cadac3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.303122:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cadac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.303131:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cadac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.303184:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cadabc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7bb expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.303199:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cadac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7bb expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.303207:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:3.0:1787906944.303210:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787906944.303213:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031a00, rc 0) 00000100:00100000:3.0:1787906944.303326:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+16:10567:x1874755972029312:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1354us (1574us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787906944.303335:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:0.0:1787906944.306480:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906944.306534:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972029568 00000100:00100000:3.0:1787906944.306545:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972029568 00000100:00100000:3.0:1787906944.306606:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:3.0:1787906944.306618:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+16:10567:x1874755972029568:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787906944.306682:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906944.306706:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cadac3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7bb expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.306722:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:3.0:1787906944.306729:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787906944.306746:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadad1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.306756:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadad1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.306763:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadad1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.306772:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadad8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x8a5222fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.306776:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8a5222fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.306780:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8a5222fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.307225:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadad1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.307237:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadad1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.307246:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadad1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.307252:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906944.307257:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadad1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.307264:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadad1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.307285:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:0.0:1787906944.307289:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906944.307293:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadad1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.307300:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadad1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.307312:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8a5222fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.307318:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadad8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8a5222fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.307324:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadad8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8a5222fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.307329:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906944.307332:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadad8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8a5222fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.307338:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadad8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8a5222fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.307346:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x8a5222fb (ffff8aa5069ca400) 00010000:00010000:0.0:1787906944.307349:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906944.307351:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadad8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8a5222fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.307358:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadad8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8a5222fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906944.307477:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+15:10567:x1874755972029568:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 860us (1003us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787906944.307487:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:0.0:1787906944.310380:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906944.310759:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972029696 00000100:00100000:2.0:1787906944.310772:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972029696 00000100:00100000:2.0:1787906944.311060:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:2.0:1787906944.311073:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+15:10567:x1874755972029696:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787906944.311098:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906944.311141:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadadf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef7c2 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.311190:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadae6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.311206:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.311219:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.311358:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadadf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c2 expref: 17 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.311379:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c2 expref: 16 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.311388:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:2.0:1787906944.311414:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787906944.311419:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97800, rc 0) 00000100:00100000:2.0:1787906944.311525:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+16:10567:x1874755972029696:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 454us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906944.311534:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:2.0:1787906944.319647:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906944.319759:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972029952 00000100:00100000:3.0:1787906944.319776:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972029952 00000100:00100000:2.0:1787906944.320315:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:2.0:1787906944.320330:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+16:10567:x1874755972029952:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787906944.320442:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadaed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.320464:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadaed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.320477:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadaed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787906944.321240:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1787906944.321256:0:5830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382593442665ns, next at 383593438583ns, rc = 0 00000004:00010000:2.0:1787906944.321381:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078a457a1 reply state 000000006fbfa1e2 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadaed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906944.321392:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787906944.323573:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+18:10567:x1874755972029952:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 3233us (3932us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1787906944.323587:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:0.0:1787906944.329619:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906944.329746:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972030080 00000100:00100000:1.0:1787906944.329759:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972030080 00000100:00100000:1.0:1787906944.329862:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:1.0:1787906944.329874:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+18:10567:x1874755972030080:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787906944.329906:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906944.329945:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadaf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef7c9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.330216:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadaed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.330251:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadaed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.330260:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadaed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.330268:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906944.330273:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadaed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.330282:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadaed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.330303:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:3.0:1787906944.330307:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787906944.330312:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadaed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.330319:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadaed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.330600:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadaf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c9 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.330616:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadaf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c9 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.330641:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:1.0:1787906944.330644:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787906944.330646:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508210600, rc 0) 00000100:00100000:1.0:1787906944.330766:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+18:10567:x1874755972030080:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 895us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906944.330786:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:0.0:1787906944.334346:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906944.334445:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972030208 00000100:00100000:3.0:1787906944.334454:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972030208 00000100:00100000:3.0:1787906944.334516:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:3.0:1787906944.334526:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755972030208:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787906944.334866:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755972030208:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 341us (528us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787906944.334874:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:2.0:1787906944.343163:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906944.343215:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972030464 00000100:00100000:1.0:1787906944.343228:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972030464 00000100:00100000:1.0:1787906944.343363:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:1.0:1787906944.343377:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+18:10567:x1874755972030464:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787906944.343693:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+19:10567:x1874755972030464:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 312us (531us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787906944.343701:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:0.0:1787906944.346316:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906944.347048:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972030720 00000100:00100000:2.0:1787906944.347063:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972030720 00000100:00100000:2.0:1787906944.347371:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:2.0:1787906944.347388:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+19:10567:x1874755972030720:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787906944.347654:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+19:10567:x1874755972030720:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 270us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906944.347663:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:0.0:1787906944.352707:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906944.354304:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972030848 00000100:00100000:2.0:1787906944.354327:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972030848 00000100:00100000:2.0:1787906944.354431:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:2.0:1787906944.354444:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+19:10567:x1874755972030848:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787906944.354474:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906944.354515:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadafb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef7d0 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.354618:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadb02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.354636:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadb02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.354649:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadb02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906944.354702:0:10853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906944.354729:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadb02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.354766:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadafb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7d0 expref: 21 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.354892:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadb02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7d0 expref: 20 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.354903:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:2.0:1787906944.354907:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787906944.354912:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96c00, rc 0) 00000100:00100000:2.0:1787906944.355020:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+20:10567:x1874755972030848:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 579us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906944.355030:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:1.0:1787906944.360646:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906944.360748:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972030976 00000100:00100000:2.0:1787906944.360762:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972030976 00000100:00100000:2.0:1787906944.360889:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:2.0:1787906944.360902:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755972030976:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787906944.360928:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906944.360956:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e9644d0/0x72bb6cf063cadb09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef7d7 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787906944.360991:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a914b80, blocks: 0x1 00010000:00010000:2.0:1787906944.361031:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1787906944.361036:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787906944.361049:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e9644d0/0x72bb6cf063cadb09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7d7 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.361069:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006e9644d0/0x72bb6cf063cadb09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7d7 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.361115:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96e00, rc 0) 00000100:00100000:2.0:1787906944.361194:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972030976:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 294us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906944.361202:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:0.0:1787906944.367574:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906944.367654:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972031232 00000100:00100000:2.0:1787906944.367668:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972031232 00000100:00100000:2.0:1787906944.367755:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:2.0:1787906944.367770:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa503053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+20:10567:x1874755972031232:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787906944.367970:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa503053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+20:10567:x1874755972031232:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 202us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906944.367987:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:0.0:1787906944.375927:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906944.376576:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972031360 00000100:00100000:3.0:1787906944.376612:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972031360 00000100:00100000:3.0:1787906944.376924:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:3.0:1787906944.376939:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:10567:x1874755972031360:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787906944.377331:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906944.377367:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cadb10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef7de expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.377418:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006e9644d0/0x72bb6cf063cadb09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7d7 expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.377430:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906944.377436:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906944.377442:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cadb10 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7de expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.377504:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006e9644d0/0x72bb6cf063cadb09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7d7 expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.377521:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006e9644d0/0x72bb6cf063cadb09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7d7 expref: 8 pid: 6675 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906944.377538:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1874756000358912:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906944.378244:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a12900 going to sleep for 11 seconds 00000100:00100000:3.0:1787906944.385982:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1874756000358912:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906944.386050:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cadb10 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7de expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.386113:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031a00, rc 0) 00000100:00100000:2.0:1787906944.386321:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+8:10567:x1874755972031360:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 9382us (10530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906944.386333:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:1.0:1787906944.387950:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906944.388233:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972031488 00000100:00100000:3.0:1787906944.388246:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972031488 00010000:00010000:3.0:1787906944.388299:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006e9644d0/0x72bb6cf063cadb09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7d7 expref: 8 pid: 6675 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906944.388349:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:3.0:1787906944.388360:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972031488:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787906944.388377:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906944.388407:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006e9644d0/0x72bb6cf063cadb09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7d7 expref: 8 pid: 6675 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.388423:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006e9644d0/0x72bb6cf063cadb09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7d7 expref: 8 pid: 6675 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.388450:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e9644d0/0x72bb6cf063cadb09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7d7 expref: 8 pid: 6675 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.388469:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906944.388474:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906944.388484:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cadb10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7de expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.388506:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cadb10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7de expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.388572:0:8506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cadb10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7de expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906944.388589:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510213480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8506:1874756000359040:192.168.204.20@tcp:105: 00000100:00100000:3.0:1787906944.388703:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a12900 going to sleep for 11 seconds 00000100:00100000:0.0:1787906944.393079:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906944.393195:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510213480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8506:1874756000359040:192.168.204.20@tcp:105: 00010000:00010000:3.0:1787906944.393239:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906944.393337:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972031488:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 4976us (5397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906944.393354:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:1.0:1787906944.393472:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972031616 00000100:00100000:1.0:1787906944.393485:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972031616 00002000:00100000:1.0:1787906944.394245:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8aa541c1ea00 x1874755972031616/t0(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:515/0 lens 504/0 e 0 to 0 dl 1787906955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787906944.394262:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa541c1ea00 with x1874755972031616 ext(0->12) 00002000:00010000:1.0:1787906944.394270:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa541c1ea00 00000100:00100000:1.0:1787906944.394632:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:1.0:1787906944.394649:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972031616:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787906944.395394:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2345:x1874755972031616:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 Request processed in 745us (2329us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787906944.395406:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00002000:00100000:1.0:1787906944.395417:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8aa541c1ea00 x1874755972031616/t4294967309(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:515/0 lens 504/448 e 0 to 0 dl 1787906955 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787906944.395440:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa541c1ea00 with x1874755972031616 ext(0->12) 00002000:00010000:1.0:1787906944.395446:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa541c1ea00 00000100:00100000:0.0:1787906944.397871:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906944.397954:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972031744 00000100:00100000:2.0:1787906944.397969:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972031744 00000100:00100000:2.0:1787906944.398039:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:2.0:1787906944.398057:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+20:10567:x1874755972031744:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787906944.449472:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1787906944.449510:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787906944.449535:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:2.0:1787906944.449760:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787906944.449789:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000359168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787906944.449927:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906944.449991:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000359168 00000100:00100000:2.0:1787906944.450002:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000359168 00000100:00100000:2.0:1787906944.450067:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787906944.450101:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000359168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787906944.450314:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787906944.450318:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787906944 00002000:00010000:2.0:1787906944.450321:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787906944.450322:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787906944 -> 1787906944 00002000:00010000:2.0:1787906944.450324:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787906944.450372:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874756000359168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 274us (445us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787906944.450379:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787906944.450435:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1787906944.450443:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967307 00000004:00080000:2.0:1787906944.450473:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa510329c00, transno 4294967307 00000100:00100000:2.0:1787906944.450498:0:3304:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8aa53aca3b80 x1874756000359168/t4294967310(4294967310) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787906960 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787906944.450512:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa53aca3b80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787906944.450518:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000359168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787906944.451160:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+15:10567:x1874755972031744:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 53104us (53352us total) trans 0 rc 0/0 00000020:00080000:1.0:1787906944.451172:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1787906944.451175:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 124 00000020:00080000:1.0:1787906944.451192:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1787906944.454124:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906944.454383:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972031872 00000100:00100000:0.0:1787906944.454399:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972031872 00000100:00100000:0.0:1787906944.454633:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:0.0:1787906944.454648:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2343:x1874755972031872:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787906944.504260:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2343:x1874755972031872:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 49592us (50131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906944.504280:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000001:00080000:2.0:1787906944.504856:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1787906944.504882:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:3.0:1787906944.513295:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906944.513565:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972032128 00000100:00100000:2.0:1787906944.513581:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972032128 00000100:00100000:2.0:1787906944.513667:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:2.0:1787906944.513679:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+15:10567:x1874755972032128:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787906944.513760:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906944.513799:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadb02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7d0 expref: 15 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.514162:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:2.0:1787906944.514169:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787906944.514211:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.514229:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.514241:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787906944.519399:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a74dad5e reply state 000000006efe5d52 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906944.519443:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787906944.519681:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+16:10567:x1874755972032128:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 5998us (6394us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787906944.519693:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 125 00010000:00010000:2.0:1787906944.522423:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.522506:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.522517:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.522525:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906944.522531:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.522541:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.522564:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:2.0:1787906944.522568:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906944.522573:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.522599:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906944.524138:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906944.524221:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972032256 00000100:00100000:2.0:1787906944.524235:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972032256 00000100:00100000:2.0:1787906944.524345:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:2.0:1787906944.524370:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755972032256:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787906944.524987:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787906944.524994:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787906944 -> 1787906943 00002000:00010000:2.0:1787906944.524997:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787906942 00002000:00010000:2.0:1787906944.525000:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787906944 -> 1787906943 00002000:00010000:2.0:1787906944.525002:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787906944.525089:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972032256:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 721us (962us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787906944.525098:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:3.0:1787906944.530948:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906944.532337:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972032512 00000100:00100000:1.0:1787906944.532360:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972032512 00000100:00100000:0.0:1787906944.534616:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:0.0:1787906944.534653:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+15:10567:x1874755972032512:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787906944.535045:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.535069:0:10853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadae6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c2 expref: 15 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.535080:0:10853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.535131:0:10853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c2 expref: 15 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.535150:0:10853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadae6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c2 expref: 15 pid: 10853 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906944.535167:0:10853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000359296:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906944.535411:0:10853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5082556c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787906944.538893:0:10853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000359296:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906944.538958:0:10853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906944.540113:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906944.540300:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972032640 00000100:00100000:2.0:1787906944.540315:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972032640 00010000:00010000:2.0:1787906944.540386:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadae6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c2 expref: 16 pid: 10853 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906944.540459:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:2.0:1787906944.540472:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+16:2345:x1874755972032640:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906944.540502:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906944.540511:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadae6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c2 expref: 16 pid: 10853 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.540550:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c2 expref: 16 pid: 10853 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.540581:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadae6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c2 expref: 16 pid: 10853 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.540604:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:2.0:1787906944.540611:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.540622:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.540632:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.540729:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906944.540843:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+15:2345:x1874755972032640:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 340us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906944.540853:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00010000:00010000:1.0:1787906944.541087:0:10853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.541098:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.541201:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.541211:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.541219:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.541226:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906944.541231:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.541239:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.541251:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:1.0:1787906944.541254:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787906944.541266:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.541273:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906944.541325:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+14:10567:x1874755972032512:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 Request processed in 6693us (10396us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787906944.541334:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:1.0:1787906944.544564:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906944.544747:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972032768 00000100:00100000:2.0:1787906944.544760:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972032768 00000100:00100000:2.0:1787906944.544942:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:2.0:1787906944.544956:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972032768:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787906944.545017:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000878316b5/0x72bb6cf063cadb25 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.545067:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cadb10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7de expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.545077:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787906944.545083:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787906944.545089:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000878316b5/0x72bb6cf063cadb25 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.545138:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cadb10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7de expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.545154:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cadb10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7de expref: 7 pid: 6673 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906944.545172:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b048700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1874756000359424:192.168.204.20@tcp:104: 00000100:00100000:2.0:1787906944.545313:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787906944.551658:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906944.551804:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b048700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1874756000359424:192.168.204.20@tcp:104: 00010000:00010000:2.0:1787906944.551869:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000878316b5/0x72bb6cf063cadb25 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906944.552437:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972032896 00000100:00100000:1.0:1787906944.552450:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972032896 00010000:00010000:1.0:1787906944.552705:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cadb10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7de expref: 8 pid: 6673 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906944.552763:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:1.0:1787906944.552775:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972032896:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906944.552795:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906944.552937:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cadb10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7de expref: 8 pid: 6673 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.552954:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cadb10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7de expref: 8 pid: 6673 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.552985:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cadb10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7de expref: 8 pid: 6673 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.553068:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787906944.553093:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787906944.553101:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000878316b5/0x72bb6cf063cadb25 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.553112:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000878316b5/0x72bb6cf063cadb25 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.553194:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906944.553282:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972032896:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 509us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906944.553291:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00010000:00010000:2.0:1787906944.554504:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000878316b5/0x72bb6cf063cadb25 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.554966:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000878316b5/0x72bb6cf063cadb25 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.555108:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000878316b5/0x72bb6cf063cadb25 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.555118:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000878316b5/0x72bb6cf063cadb25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.555202:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000878316b5/0x72bb6cf063cadb25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.555211:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787906944.555218:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000878316b5/0x72bb6cf063cadb25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.555229:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000878316b5/0x72bb6cf063cadb25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.555256:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000878316b5/0x72bb6cf063cadb25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.555265:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000878316b5/0x72bb6cf063cadb25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906944.555457:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755972032768:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 10497us (10899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906944.555468:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:3.0:1787906944.558713:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906944.559169:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972033152 00000100:00100000:0.0:1787906944.559184:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972033152 00000100:00100000:0.0:1787906944.559276:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 127 00000100:00100000:0.0:1787906944.559289:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+14:10567:x1874755972033152:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787906944.559409:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadb2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.559435:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadb2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.559451:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadb2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.559748:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.559762:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadaf4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c9 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.559771:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.559851:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadaf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c9 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.559868:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadaf4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c9 expref: 15 pid: 5832 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906944.559885:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874756000359552:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906944.560013:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5082556c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787906944.563567:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906944.563573:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874756000359552:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906944.563614:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906944.563694:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972033280 00000100:00100000:2.0:1787906944.563704:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972033280 00010000:00010000:2.0:1787906944.563754:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadaf4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c9 expref: 16 pid: 5832 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906944.563860:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:2.0:1787906944.563872:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+16:2343:x1874755972033280:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906944.563894:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906944.563903:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadaf4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c9 expref: 16 pid: 5832 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.563920:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadaf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c9 expref: 16 pid: 5832 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.563948:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadaf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7c9 expref: 16 pid: 5832 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.563968:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:2.0:1787906944.563974:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.563986:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.563995:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.564029:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906944.564094:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+15:2343:x1874755972033280:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 223us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906944.564121:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00010000:00010000:1.0:1787906944.564351:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.564361:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787906944.564796:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1787906944.565017:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1787906944.565070:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1787906944.565181:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5830:1874756000359680:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787906944.565261:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906944.565305:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa51a57fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787906944.565387:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000359680 00000100:00100000:2.0:1787906944.565397:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000359680 00000100:00100000:2.0:1787906944.565456:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787906944.565468:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5830:x1874756000359680:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787906944.565574:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5830:x1874756000359680:12345-0@lo:1000:mdt00_000.0 Request processed in 109us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906944.565581:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787906944.565780:0:5830:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787906944.565788:0:5830:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa53aca3b80, transno 4294967310 00000100:00100000:0.0:1787906944.565882:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5830:1874756000359680:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787906944.566483:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787906944.566590:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5830:1874756000359808:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787906944.566645:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906944.566687:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa508255000 going to sleep for 11 seconds 00000100:00100000:3.0:1787906944.566947:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000359808 00000100:00100000:3.0:1787906944.566955:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000359808 00000100:00100000:3.0:1787906944.567008:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787906944.567019:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5830:x1874756000359808:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787906944.567257:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5830:x1874756000359808:12345-0@lo:1000:mdt00_000.0 Request processed in 240us (611us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787906944.567276:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787906944.567421:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5830:1874756000359808:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787906944.567478:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.567503:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.567513:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.567537:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906944.567545:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.567556:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.567601:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa5069aaf00) 00010000:00010000:0.0:1787906944.567605:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787906944.567613:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.567621:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadb33 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.567663:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cada76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.567671:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cada76 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.567678:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cada76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.567683:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906944.567686:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cada76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.567693:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cada76 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.568052:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:0.0:1787906944.568056:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787906944.568065:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cada7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7ad expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.568080:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cada7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7ad expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.568092:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cada7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7ad expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.568133:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cada7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7ad expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906944.568149:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5170a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874756000359936:192.168.204.20@tcp:105: 00000100:00100000:0.0:1787906944.568252:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa508255000 going to sleep for 11 seconds 00000100:00100000:0.0:1787906944.576390:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5170a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874756000359936:192.168.204.20@tcp:105: 00010000:00010000:0.0:1787906944.576436:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cada76 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576448:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cada76 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576506:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb3a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576524:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576559:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576573:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576580:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb3a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576586:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576592:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906944.576597:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576603:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb3a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576614:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:0.0:1787906944.576617:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906944.576621:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb3a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576626:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadb3a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576639:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadb2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576645:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadb2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576655:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadb2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576660:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906944.576663:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadb2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576669:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadb2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576676:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:0.0:1787906944.576678:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787906944.576680:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadb2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.576686:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadb2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906944.577120:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+18:10567:x1874755972033152:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 17831us (18419us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787906944.577130:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 127 00000020:00080000:0.0:1787906944.577136:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787906944.577253:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906944.577340:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972033408 00000100:00100000:3.0:1787906944.577362:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972033408 00000100:00100000:3.0:1787906944.577440:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:3.0:1787906944.577453:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+18:10565:x1874755972033408:12345-192.168.204.20@tcp:49:lfs.0 00000040:00080000:1.0:1787906944.577612:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787906944.577623:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787906944.577631:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+18:10565:x1874755972033408:12345-192.168.204.20@tcp:49:lfs.0 Request processed in 178us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906944.577651:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00000040:00080000:1.0:1787906944.578243:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787906944.578255:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787906944.587559:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906944.588661:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972033664 00000100:00100000:1.0:1787906944.588673:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972033664 00000100:00100000:1.0:1787906944.588751:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 128 00000100:00100000:1.0:1787906944.588762:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+18:10565:x1874755972033664:12345-192.168.204.20@tcp:58:lfs.0 00000040:00080000:1.0:1787906944.589799:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787906944.589972:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+18:10565:x1874755972033664:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 1209us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906944.589982:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 128 00000100:00100000:2.0:1787906944.591642:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906944.591752:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972033920 00000100:00100000:3.0:1787906944.591761:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972033920 00000100:00100000:3.0:1787906944.591832:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:3.0:1787906944.591843:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa529399450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+18:10567:x1874755972033920:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787906944.592767:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787906944.593320:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1787906944.593389:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.593407:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.593421:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.593430:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb41 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.593437:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb41 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.593444:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906944.593523:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787906944.593650:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa529399450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+20:10567:x1874755972033920:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 1805us (2010us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787906944.593669:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000020:00080000:2.0:1787906944.593675:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787906944.593938:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787906944.593946:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.593954:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787906944.593958:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.593968:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.594172:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa5069aab00) 00010000:00010000:3.0:1787906944.594176:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787906944.594182:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb41 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.594194:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadb41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906944.594278:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906944.594280:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906944.594281:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906944.628221:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906944.628325:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972034048 00000100:00100000:1.0:1787906944.628335:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972034048 00000100:00100000:1.0:1787906944.628414:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:1.0:1787906944.628426:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+20:10569:x1874755972034048:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1787906944.628452:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906944.628473:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadb48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef7e5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.628553:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadb4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.628567:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadb4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.628578:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadb4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.628595:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.628602:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.628608:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.628901:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cadb5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.628909:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7a6 expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.628924:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cadb5d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.628951:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7a6 expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.628960:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7a6 expref: 21 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906944.628969:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874756000360064:192.168.204.20@tcp:104: 00000100:00100000:1.0:1787906944.629094:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa506904a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787906944.641048:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906944.641191:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874756000360064:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906944.641231:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cadb5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906944.641637:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972034304 00000100:00100000:2.0:1787906944.641645:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972034304 00000100:00100000:2.0:1787906944.641739:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:2.0:1787906944.641749:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+22:9252:x1874755972034304:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787906944.642058:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+23:9252:x1874755972034304:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 309us (1019us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787906944.642066:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:3.0:1787906944.645032:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906944.645136:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972034432 00000100:00100000:1.0:1787906944.645147:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972034432 00010000:00010000:1.0:1787906944.645186:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7a6 expref: 23 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906944.645273:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:1.0:1787906944.645284:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+23:2346:x1874755972034432:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906944.645298:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906944.645305:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7a6 expref: 23 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.645318:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7a6 expref: 23 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.645358:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cada68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7a6 expref: 23 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.645391:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:1.0:1787906944.645405:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cadb5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.645414:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cadb5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.645422:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cadb5d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906944.645451:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906944.645514:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+22:2346:x1874755972034432:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 231us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906944.645521:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00010000:00010000:0.0:1787906944.645578:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cadb5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645594:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cadb5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906944.645639:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787906944.645643:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787906944.645664:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cadb5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645677:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cadb5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645687:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadb4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645694:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadb4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645701:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadb4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645707:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906944.645712:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadb4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645720:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadb4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645730:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:0.0:1787906944.645733:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906944.645737:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadb4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645754:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadb4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645765:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645771:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645777:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645782:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906944.645785:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645791:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645800:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa518965800) 00010000:00010000:0.0:1787906944.645802:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906944.645805:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645847:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645883:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadb48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7e5 expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645894:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cadb5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7e5 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906944.645906:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:0.0:1787906944.645909:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906944.645911:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211400, rc 0) 00000100:00100000:0.0:1787906944.645938:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+21:10569:x1874755972034048:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 17515us (17728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906944.645945:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 129 00010000:00010000:3.0:1787906944.676680:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906945.035405:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906945.042763:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906945.042870:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906945.044355:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972034816 00000100:00100000:3.0:1787906945.044372:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972034816 00000100:00100000:3.0:1787906945.044467:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 157 00000100:00100000:3.0:1787906945.044491:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b04b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755972034816:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906945.044589:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b04b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755972034816:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 114us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906945.044597:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 157 00000100:00100000:3.0:1787906945.044623:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972034688 00000100:00100000:3.0:1787906945.044627:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972034688 00000100:00100000:3.0:1787906945.044652:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:3.0:1787906945.044658:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972034688:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906945.044684:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972034688:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906945.044690:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00080000:2.0:1787906945.044765:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787906945.044770:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906945.046129:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972034560 00000100:00100000:0.0:1787906945.046139:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972034560 00000100:00100000:0.0:1787906945.046976:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 298 00000100:00100000:0.0:1787906945.046989:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755972034560:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906945.047064:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755972034560:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 77us (11673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906945.047073:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 298 00000040:00080000:3.0:1787906945.637547:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787906945.637556:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787906945.637604:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787906945.637896:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787906945.638211:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510b81f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874756000360192:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787906945.640340:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50723f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787906945.685860:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906945.685933:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510b81f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874756000360192:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787906945.687869:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972034944 00000100:00100000:0.0:1787906945.687886:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972034944 00000100:00100000:0.0:1787906945.687961:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 130 00000100:00100000:0.0:1787906945.687972:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+21:10580:x1874755972034944:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787906945.688010:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787906945.690524:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+21:10580:x1874755972034944:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 2540us (4660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906945.690539:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 130 00000100:00080000:0.0:1787906945.692276:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906945.696305:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000360320:0@lo:400:kworker.0 00000100:00100000:0.0:1787906945.696604:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52efe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000360448:0@lo:400:kworker.0 00000100:00100000:0.0:1787906945.696756:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906945.696837:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000360960:0@lo:400:kworker.0 00000100:00100000:0.0:1787906945.696867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906945.696900:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787906945.696909:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000360576:0@lo:400:kworker.0 00000100:00100000:0.0:1787906945.696933:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906945.696966:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000360960 00000100:00100000:0.0:1787906945.696975:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000360960 00000100:00100000:1.0:1787906945.696991:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000360448 00000100:00100000:1.0:1787906945.696998:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000360448 00000100:00100000:1.0:1787906945.697053:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000360576 00000100:00100000:1.0:1787906945.697057:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000360576 00000100:00100000:1.0:1787906945.697092:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787906945.697103:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000360448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906945.697175:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000360448:12345-0@lo:400:kworker.0 Request processed in 74us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906945.697183:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787906945.697202:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787906945.697208:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000360576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906945.697256:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000360576:12345-0@lo:400:kworker.0 Request processed in 49us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906945.697262:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787906945.697446:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906945.697496:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000360832:0@lo:400:kworker.0 00000100:00100000:2.0:1787906945.697523:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906945.697545:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787906945.697551:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000360704:0@lo:400:kworker.0 00000100:00100000:2.0:1787906945.697574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906945.697768:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000360320 00000100:00100000:1.0:1787906945.697775:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000360320 00010000:00010000:3.0:1787906945.697792:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906945.698785:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000360704 00000100:00100000:0.0:1787906945.698793:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000360704 00000100:00100000:0.0:1787906945.698832:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787906945.698841:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1874756000360960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906945.698895:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1874756000360960:12345-0@lo:400:kworker.0 Request processed in 56us (2027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906945.698901:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787906945.698914:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787906945.698920:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1874756000360704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906945.698947:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1874756000360704:12345-0@lo:400:kworker.0 Request processed in 28us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906945.698952:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787906945.698968:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000360832 00000100:00100000:0.0:1787906945.698971:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000360832 00000100:00100000:0.0:1787906945.699001:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787906945.699007:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000360832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906945.699032:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000360832:12345-0@lo:400:kworker.0 Request processed in 26us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906945.699047:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787906945.699130:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000360704:0@lo:400:kworker.0 00000100:00100000:0.0:1787906945.699141:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000360832:0@lo:400:kworker.0 00000100:00100000:1.0:1787906945.700725:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787906945.700746:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000360320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906945.701263:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000360320:12345-0@lo:400:kworker.0 Request processed in 524us (3815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906945.701273:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000040:00080000:2.0:1787906945.702094:0:12116:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787906945.702112:0:12116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787906945.702175:0:12116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787906945.702184:0:12116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00080000:2.0:1787906945.703479:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787906945.703489:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787906945.703500:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906945.703571:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000360576:0@lo:400:kworker.0 00000100:00100000:2.0:1787906945.703594:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000360448:0@lo:400:kworker.0 00000100:00100000:2.0:1787906945.703613:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000360960:0@lo:400:kworker.0 00000100:00100000:1.0:1787906945.715112:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52efe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000360320:0@lo:400:kworker.0 00000100:00100000:1.0:1787906945.715221:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906945.715257:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972035200 00000100:00100000:1.0:1787906945.715265:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972035200 00000100:00100000:1.0:1787906945.715314:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:1.0:1787906945.715323:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+21:10580:x1874755972035200:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787906945.715344:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906945.715369:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadb64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef7ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906945.715502:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906945.715518:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906945.716797:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906945.717167:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787906945.717354:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadb64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7ec expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906945.717387:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7ec expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906945.717397:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:1.0:1787906945.717401:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787906945.717405:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508210a00, rc 0) 00000100:00100000:1.0:1787906945.717490:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+23:10580:x1874755972035200:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 2166us (2269us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787906945.717500:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:3.0:1787906945.728172:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906945.729287:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972035328 00000100:00100000:1.0:1787906945.729301:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972035328 00000100:00100000:1.0:1787906945.729473:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1787906945.729487:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+23:2344:x1874755972035328:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906945.729505:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906945.729539:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063cadb6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7ec expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906945.729556:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:1.0:1787906945.729562:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906945.729626:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+22:2344:x1874755972035328:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 142us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906945.729633:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:3.0:1787906945.731834:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906945.732915:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972035584 00000100:00100000:2.0:1787906945.732931:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972035584 00000100:00100000:2.0:1787906945.734928:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 132 00000100:00100000:2.0:1787906945.734956:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+22:10580:x1874755972035584:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787906945.738073:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadb79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906945.738104:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadb79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906945.738118:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadb79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906945.738380:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadb79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906945.738388:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadb79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906945.738395:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadb79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906945.738401:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906945.738407:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadb79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906945.738428:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadb79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906945.738445:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:2.0:1787906945.738449:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787906945.738453:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadb79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906945.738459:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadb79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906945.738696:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+23:10580:x1874755972035584:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 3747us (6885us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787906945.738707:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 132 00000040:00080000:2.0:1787906945.744076:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787906945.744084:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787906945.744591:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787906945.744602:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787906945.759766:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906945.759827:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972035840 00000100:00100000:0.0:1787906945.759839:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972035840 00000100:00100000:0.0:1787906945.759896:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:0.0:1787906945.759909:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+23:10580:x1874755972035840:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787906945.760216:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+24:10580:x1874755972035840:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 309us (463us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787906945.760224:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000001:00080000:1.0:1787906945.779606:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1787906945.779634:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1787906946.208723:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787906946.208746:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000361088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787906946.209017:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906946.209149:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000361088 00000100:00100000:0.0:1787906946.209232:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000361088 00000100:00100000:0.0:1787906946.209623:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787906946.209633:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874756000361088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787906946.209668:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906946.209729:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874756000361088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906946.209736:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787906946.209849:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000361088:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906946.720254:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906947.744268:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787906948.125071:0:12169:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787906948.125085:0:12169:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787906948.125131:0:12169:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787906948.125140:0:12169:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787906948.301958:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906948.302768:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972036096 00000100:00100000:3.0:1787906948.302782:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972036096 00000100:00100000:3.0:1787906948.302873:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:3.0:1787906948.302885:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+24:10601:x1874755972036096:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906948.302910:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906948.302932:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadb80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef7f3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906948.303057:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cadb87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906948.303070:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cadb87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906948.303081:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cadb87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906948.303092:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787906948.303441:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadb80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7f3 expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906948.303473:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cadb87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7f3 expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906948.303481:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:3.0:1787906948.303484:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787906948.303488:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031200, rc 0) 00000100:00080000:2.0:1787906948.303619:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906948.303670:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+26:10601:x1874755972036096:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 787us (1729us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787906948.303678:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:1.0:1787906948.328245:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906948.353129:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972036224 00000100:00100000:2.0:1787906948.353144:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972036224 00000100:00100000:2.0:1787906948.353257:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00100000:2.0:1787906948.353268:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+26:10601:x1874755972036224:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:2.0:1787906948.353334:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadb95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906948.353351:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadb95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906948.353556:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadb95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906948.353588:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadb95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906948.353595:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadb95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906948.353601:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadb95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906948.353607:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906948.353612:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadb95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906948.353619:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadb95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906948.353633:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:2.0:1787906948.353636:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787906948.353640:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadb95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906948.353653:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadb95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906948.353739:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+26:10601:x1874755972036224:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 472us (25503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906948.354469:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00100000:2.0:1787906948.462774:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906948.464883:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972036352 00000100:00100000:0.0:1787906948.464900:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972036352 00000100:00100000:0.0:1787906948.464994:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:0.0:1787906948.465006:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755972036352:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:0.0:1787906948.465024:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906948.465060:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a96e189/0x72bb6cf063cadb9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef7fa expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787906948.465093:0:8459:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a914b7f, atime: 0x6a914b7e, ctime: 0x6a914b7f, blocks: 0xb 00010000:00010000:0.0:1787906948.465115:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1787906948.465120:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787906948.465130:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a96e189/0x72bb6cf063cadb9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7fa expref: 7 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906948.465149:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a96e189/0x72bb6cf063cadb9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7fa expref: 7 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906948.465163:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f200, rc 0) 00000100:00100000:0.0:1787906948.465229:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2343:x1874755972036352:12345-192.168.204.20@tcp:101:cat.0 Request processed in 225us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906948.465235:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00080000:2.0:1787906948.465331:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787906948.478110:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906948.479246:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972036480 00000100:00100000:0.0:1787906948.479259:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972036480 00002000:00100000:0.0:1787906948.479316:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8aa507ee5c00 x1874755972036480/t0(0) o3->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:519/0 lens 488/0 e 0 to 0 dl 1787906959 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787906948.479328:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa507ee5c00 with x1874755972036480 ext(0->4095) 00002000:00010000:0.0:1787906948.479344:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa507ee5c00 00000100:00100000:0.0:1787906948.479380:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:0.0:1787906948.479390:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972036480:12345-192.168.204.20@tcp:3:cat.0 00000100:00100000:0.0:1787906948.479679:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972036480:12345-192.168.204.20@tcp:3:cat.0 Request processed in 290us (1576us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787906948.479699:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00002000:00100000:0.0:1787906948.479708:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8aa507ee5c00 x1874755972036480/t0(0) o3->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:519/0 lens 488/4536 e 0 to 0 dl 1787906959 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787906948.479717:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa507ee5c00 with x1874755972036480 ext(0->4095) 00002000:00010000:0.0:1787906948.479720:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa507ee5c00 00000100:00100000:1.0:1787906948.768235:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5170a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000361216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787906948.768331:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906948.768750:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000361216 00000100:00100000:0.0:1787906948.768759:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000361216 00000100:00100000:0.0:1787906948.768850:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787906948.768862:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000361216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787906948.768897:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906948.768951:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000361216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906948.768959:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787906948.769004:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787906948.769010:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1787906948.769027:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa52f3b8700, transno 4294967304 00000100:00100000:0.0:1787906948.769047:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5170a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000361216:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787906948.769877:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787906948.770316:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787906948.832352:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787906948.832365:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787906948.832400:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787906948.832422:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787906949.793660:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787906949.884020:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1787906949.884045:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1787906949.891866:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1787906949.891889:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa51a45be40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787906949.891894:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa507c04400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa50a12f900 00000020:00080000:3.0:1787906949.891898:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa507c04300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa5172c6800 00000001:00080000:3.0:1787906949.891941:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787906949.892244:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787906949.892451:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1787906950.166947:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906950.167007:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906950.167798:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906950.167850:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906950.167883:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906950.167993:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972036864 00000100:00100000:1.0:1787906950.168006:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972036864 00000100:00100000:1.0:1787906950.169097:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972036992 00000100:00100000:1.0:1787906950.169109:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972036992 00000100:00100000:1.0:1787906950.169149:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 89 00000100:00100000:1.0:1787906950.169163:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2344:x1874755972036864:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906950.169275:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2344:x1874755972036864:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 114us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906950.169283:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 89 00000100:00100000:1.0:1787906950.169304:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:1.0:1787906950.169311:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2344:x1874755972036992:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906950.169338:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2344:x1874755972036992:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906950.169344:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:1.0:1787906950.169391:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972037120 00000100:00100000:1.0:1787906950.169395:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972037120 00000100:00100000:1.0:1787906950.173123:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972036736 00000100:00100000:1.0:1787906950.173145:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972036736 00000100:00100000:1.0:1787906950.173216:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 161 00000100:00100000:1.0:1787906950.173228:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2344:x1874755972037120:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906950.173353:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2344:x1874755972037120:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 127us (5557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906950.173360:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 161 00000100:00100000:1.0:1787906950.173392:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 162 00000100:00100000:1.0:1787906950.173400:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+13:2344:x1874755972036736:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906950.173428:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+13:2344:x1874755972036736:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (5578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906950.173435:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 162 00000100:00080000:1.0:1787906950.173481:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787906950.173487:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787906950.173491:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787906950.186293:0:11686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972036608 00000100:00100000:3.0:1787906950.186317:0:11686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972036608 00000100:00100000:3.0:1787906950.186450:0:11686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 300 00000100:00100000:3.0:1787906950.186464:0:11686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+13:2344:x1874755972036608:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906950.186576:0:11686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+13:2344:x1874755972036608:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 114us (19646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906950.186583:0:11686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 300 00000100:00100000:1.0:1787906950.818670:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000361472:0@lo:400:kworker.0 00000100:00100000:1.0:1787906950.818793:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906950.818915:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000361984:0@lo:400:kworker.0 00000100:00100000:1.0:1787906950.818946:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906950.818983:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787906950.818988:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000361600:0@lo:400:kworker.0 00000100:00100000:1.0:1787906950.819024:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906950.819061:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000361472 00000100:00100000:1.0:1787906950.819071:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000361472 00000100:00100000:1.0:1787906950.819146:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000361600 00000100:00100000:1.0:1787906950.819149:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000361600 00000100:00100000:1.0:1787906950.819184:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787906950.819195:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000361472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906950.819264:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000361472:12345-0@lo:400:kworker.0 Request processed in 70us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906950.819272:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787906950.819294:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787906950.819300:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000361600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906950.819326:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000361600:12345-0@lo:400:kworker.0 Request processed in 26us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906950.819332:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787906950.819357:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000361984 00000100:00100000:1.0:1787906950.819361:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000361984 00000100:00100000:1.0:1787906950.819414:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787906950.819420:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000361984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906950.819452:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000361984:12345-0@lo:400:kworker.0 Request processed in 32us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906950.819458:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1787906950.819484:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787906950.819490:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906950.819532:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000361600:0@lo:400:kworker.0 00000100:00100000:1.0:1787906950.819543:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000361472:0@lo:400:kworker.0 00000100:00100000:1.0:1787906950.819550:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787906950.819557:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787906950.819586:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000361984:0@lo:400:kworker.0 00000100:00100000:2.0:1787906950.823186:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000361344:0@lo:400:kworker.0 00000100:00100000:2.0:1787906950.823317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906950.823404:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000361856:0@lo:400:kworker.0 00000100:00100000:2.0:1787906950.823440:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906950.823476:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787906950.823484:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000361728:0@lo:400:kworker.0 00000100:00100000:2.0:1787906950.823515:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787906950.825354:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906950.827168:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000361344 00000100:00100000:1.0:1787906950.827198:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000361344 00000100:00100000:1.0:1787906950.827307:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787906950.827323:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000361344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906950.827483:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000361344:12345-0@lo:400:kworker.0 Request processed in 164us (4166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906950.827493:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787906950.827548:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000361728 00000100:00100000:1.0:1787906950.827555:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000361728 00000100:00100000:1.0:1787906950.827599:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787906950.827608:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000361728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906950.827653:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000361728:12345-0@lo:400:kworker.0 Request processed in 48us (4138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906950.827660:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1787906950.827688:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787906950.827704:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000361856 00000100:00100000:1.0:1787906950.827708:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000361856 00000100:00100000:1.0:1787906950.827745:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787906950.827752:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000361856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906950.827790:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000361856:12345-0@lo:400:kworker.0 Request processed in 39us (4349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906950.827796:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1787906950.827837:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906950.827895:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000361728:0@lo:400:kworker.0 00000100:00100000:1.0:1787906950.827911:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000361344:0@lo:400:kworker.0 00000100:00100000:1.0:1787906950.827923:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000361856:0@lo:400:kworker.0 00000100:00100000:2.0:1787906951.328460:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787906951.328515:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000362112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787906951.328658:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906951.328856:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000362112 00000100:00100000:0.0:1787906951.328867:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000362112 00000100:00100000:0.0:1787906951.328933:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787906951.328947:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa51032b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000362112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787906951.329005:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906951.329082:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa51032b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000362112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906951.329091:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787906951.330627:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000362112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906951.840382:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906952.864053:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906953.888786:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906953.890259:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5170a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000362240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787906953.890379:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906953.890574:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000362240 00000100:00100000:0.0:1787906953.890589:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000362240 00000100:00100000:0.0:1787906953.890685:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787906953.890699:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000362240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787906953.890758:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906953.890853:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000362240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906953.890862:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787906953.890926:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5170a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000362240:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787906953.891155:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787906954.911960:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787906954.971162:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1787906954.971540:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787906954.971557:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787906955.207956:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906955.208501:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972037248 00000100:00100000:1.0:1787906955.208517:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972037248 00000100:00100000:1.0:1787906955.208603:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 135 00000100:00100000:1.0:1787906955.208616:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+13:10245:x1874755972037248:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787906955.208747:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+13:10245:x1874755972037248:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 Request processed in 133us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906955.208754:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 135 00000100:00080000:3.0:1787906955.209631:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906955.226796:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906955.229134:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972037504 00000100:00100000:1.0:1787906955.229151:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972037504 00000100:00100000:1.0:1787906955.229232:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:1.0:1787906955.229243:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+13:10245:x1874755972037504:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787906955.230056:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+14:10245:x1874755972037504:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 808us (3265us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787906955.230068:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:1.0:1787906955.278733:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906955.280149:0:11686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972037632 00000100:00100000:3.0:1787906955.280166:0:11686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972037632 00000100:00100000:3.0:1787906955.280512:0:11686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 302 00000100:00100000:3.0:1787906955.280524:0:11686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755972037632:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906955.280626:0:11686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755972037632:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 104us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906955.280634:0:11686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 302 00000100:00100000:1.0:1787906955.287909:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906955.287954:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906955.288047:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906955.288148:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972038016 00000100:00100000:0.0:1787906955.288148:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972037760 00000100:00100000:3.0:1787906955.288160:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972038016 00000100:00100000:0.0:1787906955.288160:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972037760 00000100:00100000:2.0:1787906955.288230:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972037888 00000100:00100000:2.0:1787906955.288234:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972037888 00000100:00100000:3.0:1787906955.288438:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:3.0:1787906955.288448:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755972038016:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906955.288524:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755972038016:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 77us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906955.288532:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:0.0:1787906955.295842:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 93 00000100:00100000:0.0:1787906955.295863:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755972037760:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906955.295950:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755972037760:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 96us (8054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906955.295958:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 93 00000100:00080000:1.0:1787906955.301833:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787906955.301844:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787906955.301848:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906955.305240:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:3.0:1787906955.305291:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755972037888:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906955.305809:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755972037888:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 550us (17759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906955.305840:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:1.0:1787906955.766186:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906955.766368:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972038144 00000100:00100000:2.0:1787906955.766383:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972038144 00000100:00100000:2.0:1787906955.766464:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00100000:2.0:1787906955.766477:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:11055:x1874755972038144:12345-192.168.204.20@tcp:101:lsof.0 00010000:00010000:2.0:1787906955.766505:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906955.766534:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef801 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906955.766618:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadbaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906955.766635:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadbaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906955.766652:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadbaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906955.769335:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787906955.769350:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906955.769485:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadbaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906955.769542:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef801 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906955.769566:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadbaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef801 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906955.769586:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:2.0:1787906955.769590:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787906955.769595:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97a00, rc 0) 00000100:00100000:2.0:1787906955.771026:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:11055:x1874755972038144:12345-192.168.204.20@tcp:101:lsof.0 Request processed in 4466us (4770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906955.771042:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00100000:1.0:1787906955.936558:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000362624:0@lo:400:kworker.0 00000100:00100000:1.0:1787906955.936657:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906955.936746:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787906955.936751:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000362496:0@lo:400:kworker.0 00000100:00100000:1.0:1787906955.936799:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906955.936839:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000363008:0@lo:400:kworker.0 00000100:00100000:1.0:1787906955.936865:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906955.936905:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000362624 00000100:00100000:1.0:1787906955.936914:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000362624 00000100:00100000:0.0:1787906955.937126:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000362368:0@lo:400:kworker.0 00000100:00100000:0.0:1787906955.937187:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906955.937224:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000362880:0@lo:400:kworker.0 00000100:00100000:0.0:1787906955.937254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906955.937301:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787906955.937308:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000362752:0@lo:400:kworker.0 00000100:00100000:0.0:1787906955.937340:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906955.937427:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000362368 00000100:00100000:0.0:1787906955.937433:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000362368 00000100:00100000:0.0:1787906955.937507:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787906955.937529:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000362368:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1787906955.937531:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906955.937600:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000362496 00000100:00100000:0.0:1787906955.937609:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000362368:12345-0@lo:400:kworker.0 Request processed in 78us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906955.937616:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000362496 00000100:00100000:0.0:1787906955.937624:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787906955.937708:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000362368:0@lo:400:kworker.0 00000100:00100000:3.0:1787906955.937723:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000362880 00000100:00100000:3.0:1787906955.937731:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000362880 00000100:00100000:1.0:1787906955.948643:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787906955.948767:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787906955.948841:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000362624:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787906955.949090:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906955.949203:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000362624:12345-0@lo:400:kworker.0 Request processed in 415us (12543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906955.949214:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787906955.949238:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787906955.949249:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000362880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906955.949312:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000362880:12345-0@lo:400:kworker.0 Request processed in 65us (12056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906955.949319:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787906955.949371:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000363008 00000100:00100000:3.0:1787906955.949380:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000363008 00000100:00100000:1.0:1787906955.949405:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000362624:0@lo:400:kworker.0 00000100:00100000:1.0:1787906955.949462:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000362496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906955.949550:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000362496:12345-0@lo:400:kworker.0 Request processed in 846us (12749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906955.949559:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787906955.949602:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000362496:0@lo:400:kworker.0 00000100:00100000:1.0:1787906955.949763:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000362752 00000100:00100000:1.0:1787906955.949770:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000362752 00000100:00100000:1.0:1787906955.949875:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787906955.949884:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000362752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906955.949924:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000362752:12345-0@lo:400:kworker.0 Request processed in 42us (12584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906955.949931:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1787906955.949947:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787906955.950011:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000362752:0@lo:400:kworker.0 00000100:00100000:1.0:1787906955.950030:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000362880:0@lo:400:kworker.0 00000100:00100000:3.0:1787906955.950709:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787906955.950722:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000363008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906955.950797:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000363008:12345-0@lo:400:kworker.0 Request processed in 78us (13931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906955.950805:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1787906955.950908:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787906955.950999:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000363008:0@lo:400:kworker.0 00000100:00100000:3.0:1787906956.449264:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787906956.449317:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000363136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787906956.449673:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906956.454267:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000363136 00000100:00100000:0.0:1787906956.454296:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000363136 00000100:00100000:0.0:1787906956.454431:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787906956.454449:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000363136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787906956.454521:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906956.454673:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000363136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 229us (5000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906956.454689:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787906956.455469:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000363136:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906956.960082:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906957.984187:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787906958.048394:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787906958.048417:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787906958.049434:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787906958.049451:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787906959.008087:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906959.008269:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5170a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000363264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906959.008411:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906959.010530:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000363264 00000100:00100000:0.0:1787906959.010559:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000363264 00000100:00100000:0.0:1787906959.010709:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787906959.010741:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510329c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000363264:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787906959.011097:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787906959.011144:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906959.011437:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510329c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000363264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 712us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906959.011448:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787906959.011721:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5170a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000363264:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787906960.032231:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787906960.123617:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000100:00100000:0.0:1787906960.399211:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906960.399294:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906960.399329:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906960.399362:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906960.399397:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906960.399719:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972038528 00000100:00100000:3.0:1787906960.399730:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972038528 00000100:00100000:3.0:1787906960.399796:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972038656 00000100:00100000:3.0:1787906960.399800:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972038656 00000100:00080000:2.0:1787906960.399911:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787906960.399918:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787906960.400049:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:3.0:1787906960.400063:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755972038528:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906960.400160:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755972038528:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 101us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906960.400168:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:3.0:1787906960.400199:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 98 00000100:00100000:3.0:1787906960.400206:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755972038656:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906960.400232:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755972038656:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906960.400239:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 98 00000100:00100000:3.0:1787906960.400262:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972038784 00000100:00100000:3.0:1787906960.400266:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972038784 00000100:00100000:3.0:1787906960.400297:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972038400 00000100:00100000:3.0:1787906960.400300:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972038400 00000100:00100000:3.0:1787906960.400318:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 170 00000100:00100000:3.0:1787906960.400325:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:2343:x1874755972038784:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:2.0:1787906960.400431:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906960.400444:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 171 00000100:00100000:2.0:1787906960.400453:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+13:2343:x1874755972038400:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906960.400491:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+13:2343:x1874755972038400:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 41us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906960.400497:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 171 00000100:00100000:3.0:1787906960.400553:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:2343:x1874755972038784:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 228us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906960.400560:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 170 00000100:00100000:1.0:1787906960.403589:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972038272 00000100:00100000:1.0:1787906960.403607:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972038272 00000100:00100000:1.0:1787906960.403791:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 304 00000100:00100000:1.0:1787906960.403804:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2343:x1874755972038272:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906960.403916:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9eec00eb-d19d-4892-ad44-299469e66291+13:2343:x1874755972038272:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 116us (4718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906960.403925:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 304 00000001:02000400:2.0:1787906960.844959:0:12372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:49:18 (1787906958) 00000100:00100000:1.0:1787906961.056087:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000363648:0@lo:400:kworker.0 00000100:00100000:1.0:1787906961.056185:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906961.056269:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787906961.056275:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000363520:0@lo:400:kworker.0 00000100:00100000:1.0:1787906961.056299:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906961.056316:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000364032:0@lo:400:kworker.0 00000100:00100000:1.0:1787906961.056342:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906961.056382:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000363648 00000100:00100000:1.0:1787906961.056392:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000363648 00000100:00100000:1.0:1787906961.056454:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000363520 00000100:00100000:1.0:1787906961.056603:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000363520 00000100:00100000:1.0:1787906961.056633:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787906961.056642:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000363648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906961.056723:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa40203e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000363776:0@lo:400:kworker.0 00000100:00100000:3.0:1787906961.057866:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000363392:0@lo:400:kworker.0 00000100:00100000:0.0:1787906961.060583:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906961.060793:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000363648:12345-0@lo:400:kworker.0 Request processed in 4149us (4605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906961.060977:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787906961.061017:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787906961.061030:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000363520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906961.061101:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000363520:12345-0@lo:400:kworker.0 Request processed in 77us (4801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906961.061106:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1787906961.061128:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906961.061302:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000364032 00000100:00100000:0.0:1787906961.061310:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000364032 00000100:00100000:0.0:1787906961.061368:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000363776 00000100:00100000:0.0:1787906961.061372:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000363776 00000100:00100000:0.0:1787906961.061394:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787906961.061401:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000364032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906961.061437:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000364032:12345-0@lo:400:kworker.0 Request processed in 37us (5094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906961.061443:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787906961.064627:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787906961.064663:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000363776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906961.065649:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000363776:12345-0@lo:400:kworker.0 Request processed in 995us (5070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906961.066042:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000363520:0@lo:400:kworker.0 00000100:00100000:1.0:1787906961.066086:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000364032:0@lo:400:kworker.0 00000100:00100000:1.0:1787906961.066099:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000363648:0@lo:400:kworker.0 00000100:00080000:1.0:1787906961.068076:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787906961.068087:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787906961.072868:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906961.072908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906961.072968:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000363904:0@lo:400:kworker.0 00000100:00100000:3.0:1787906961.073012:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906961.073050:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000363904 00000100:00100000:3.0:1787906961.073057:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000363904 00000100:00100000:3.0:1787906961.073109:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787906961.073118:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000363904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906961.073182:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000363904:12345-0@lo:400:kworker.0 Request processed in 65us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906961.073190:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787906961.073233:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000363904:0@lo:400:kworker.0 00000100:00100000:1.0:1787906961.074372:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000363392 00000100:00100000:1.0:1787906961.074382:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000363392 00000100:00100000:1.0:1787906961.074430:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787906961.074439:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000363392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906961.074513:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000363392:12345-0@lo:400:kworker.0 Request processed in 77us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906961.074519:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:1.0:1787906961.074550:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906961.075049:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000363392:0@lo:400:kworker.0 00000100:00100000:1.0:1787906961.075917:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa40203e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000363776:0@lo:400:kworker.0 00000100:00100000:0.0:1787906961.083172:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787906961.568400:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000364160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787906961.568488:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906961.568793:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000364160 00000100:00100000:3.0:1787906961.568802:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000364160 00000100:00100000:3.0:1787906961.568877:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787906961.568888:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000364160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787906961.568923:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906961.573662:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000364160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4764us (5162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906961.573678:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787906961.575258:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000364160:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906962.080008:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906962.525786:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906962.525865:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972039040 00000100:00100000:2.0:1787906962.525887:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972039040 00000100:00100000:2.0:1787906962.525965:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 137 00000100:00100000:2.0:1787906962.525977:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+13:11321:x1874755972039040:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787906962.525995:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906962.526015:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadbb1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef808 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.526080:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadbb8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.526094:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadbb8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.526106:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadbb8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.526170:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadbbf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.526178:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadbbf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.526184:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadbbf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787906962.526472:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787906962.527277:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadbc6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.527291:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.527299:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906962.527315:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787906962.527527:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadbb8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.527537:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadbb8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.527543:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadbb8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.527549:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906962.527553:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadbb8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.527561:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadbb8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.527586:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8aa510860200) 00010000:00010000:2.0:1787906962.527590:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906962.527594:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadbb8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.527600:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadbb8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.528909:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadbbf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.528921:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadbbf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.528945:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadbbf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.528951:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96e00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906962.528955:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadbbf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.528962:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadbbf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.528974:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8aa5069aa900) 00010000:00010000:2.0:1787906962.528977:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906962.528982:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadbbf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.528987:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadbbf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.529440:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadbb1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef808 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.529456:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadbc6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef808 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906962.529463:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa518965b00) 00010000:00010000:2.0:1787906962.529466:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906962.529468:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97600, rc 0) 00000100:00100000:2.0:1787906962.529533:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+15:11321:x1874755972039040:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 3558us (3757us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787906962.529551:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 137 00000100:00100000:2.0:1787906962.545070:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906962.545203:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972039168 00000100:00100000:3.0:1787906962.545214:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972039168 00000100:00100000:2.0:1787906962.545269:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906962.545270:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 138 00000100:00100000:3.0:1787906962.545280:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+15:11321:x1874755972039168:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787906962.545475:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+15:11321:x1874755972039168:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 Request processed in 195us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906962.545484:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 138 00000100:00100000:1.0:1787906962.548829:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972039296 00000100:00100000:1.0:1787906962.548846:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972039296 00000100:00100000:1.0:1787906962.548951:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:1.0:1787906962.548961:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510225c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+15:2344:x1874755972039296:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906962.548977:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906962.549006:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadbc6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef808 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906962.549028:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa518965b00) 00010000:00010000:1.0:1787906962.549032:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906962.549116:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510225c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+14:2344:x1874755972039296:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 156us (3846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906962.553998:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00010000:00010000:3.0:1787906963.104227:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787906963.168230:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787906963.168243:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787906963.169597:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787906963.169613:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787906964.128122:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906964.129681:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787906964.129844:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000364288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787906964.129920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906964.130018:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000364288 00000100:00100000:3.0:1787906964.130027:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000364288 00000100:00100000:3.0:1787906964.130090:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787906964.130099:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000364288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787906964.130141:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906964.130183:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000364288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906964.130189:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1787906964.134673:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906964.134751:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000364288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906964.548208:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906964.548444:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972039424 00000100:00100000:0.0:1787906964.548455:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972039424 00000100:00100000:0.0:1787906964.548548:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 139 00000100:00100000:0.0:1787906964.548560:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+14:11363:x1874755972039424:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1787906964.548583:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906964.548609:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef80f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787906964.548644:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787906964.548676:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadbdb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.548691:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadbdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.548703:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadbdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.548718:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadbe2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.548726:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.548732:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549021:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadbdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549030:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadbdb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549037:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadbdb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549044:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906964.549049:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadbdb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549067:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadbdb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549079:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:0.0:1787906964.549082:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906964.549086:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadbdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549092:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadbdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549114:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549121:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadbe2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549127:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadbe2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549133:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906964.549135:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadbe2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549141:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadbe2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549148:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8aa510860c00) 00010000:00010000:0.0:1787906964.549151:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906964.549153:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadbe2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549177:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadbe2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549212:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbd4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef80f expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549223:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:0.0:1787906964.549225:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906964.549229:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef80f expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.549238:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f800, rc 0) 00000100:00100000:0.0:1787906964.549306:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+14:11363:x1874755972039424:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 749us (1108us total) trans 0 rc 301/301 00000100:00100000:0.0:1787906964.549314:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 139 00000100:00100000:2.0:1787906964.570083:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906964.570298:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972039680 00000100:00100000:0.0:1787906964.570309:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972039680 00000100:00100000:0.0:1787906964.570369:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 140 00000100:00100000:0.0:1787906964.570380:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+14:11363:x1874755972039680:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:0.0:1787906964.570453:0:10853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906964.570485:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cad552 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef648 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.570504:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:0.0:1787906964.570510:0:10853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787906964.570799:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.570847:0:10853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadbaa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef801 expref: 5 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.570857:0:10853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.570893:0:10853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadbaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef801 expref: 5 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.571249:0:10853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadbaa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef801 expref: 5 pid: 5830 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906964.571268:0:10853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507d3aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000364416:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906964.571359:0:10853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa516c956c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787906964.581938:0:10853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507d3aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000364416:192.168.204.20@tcp:104: 00010000:00010000:1.0:1787906964.581971:0:10853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906964.582175:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906964.582522:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972039808 00000100:00100000:2.0:1787906964.582530:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972039808 00010000:00010000:2.0:1787906964.582575:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadbaa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef801 expref: 6 pid: 5830 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906964.582607:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:2.0:1787906964.582617:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:2345:x1874755972039808:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906964.582630:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906964.582713:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadbaa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef801 expref: 6 pid: 5830 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906964.582726:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadbaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef801 expref: 6 pid: 5830 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906964.582747:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadbaa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef801 expref: 6 pid: 5830 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906964.582761:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:2.0:1787906964.582766:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906964.582785:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906964.582792:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906964.582833:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906964.582887:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755972039808:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 271us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906964.582895:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00080000:1.0:1787906964.583111:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787906964.583126:0:10853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906964.583134:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906964.583162:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadbf0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906964.583173:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadbf0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906964.583181:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadbf0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906964.584472:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787906964.584486:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906964.584495:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906964.584502:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906964.584508:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906964.584513:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906964.584521:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906964.584534:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:1.0:1787906964.584538:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906964.584542:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906964.584548:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadbe9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787906964.584567:0:10853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013e6a643 reply state 000000003f6b6fff transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadbf0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906964.584575:0:10853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787906964.584657:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+15:11363:x1874755972039680:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 14276us (14583us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787906964.584674:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 140 00010000:00010000:0.0:1787906964.601237:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadbf0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.601261:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadbf0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.601270:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadbf0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.601277:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906964.601284:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadbf0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.601294:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadbf0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.601330:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8aa518965300) 00010000:00010000:0.0:1787906964.601335:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906964.601341:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadbf0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.601350:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadbf0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906964.693391:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906964.693527:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972039936 00000100:00100000:0.0:1787906964.693538:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972039936 00000100:00100000:0.0:1787906964.693607:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 141 00000100:00100000:0.0:1787906964.693620:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+14:11371:x1874755972039936:12345-192.168.204.20@tcp:101:lctl.0 00010000:00010000:0.0:1787906964.693645:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906964.693670:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadbf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef816 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.693737:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadbfe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.693750:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadbfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.693760:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadbfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906964.693866:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787906964.693871:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787906964.693904:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadbfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.693951:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadbf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef816 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.693970:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadbfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef816 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.693978:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa510860c00) 00010000:00010000:0.0:1787906964.693981:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787906964.693985:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8e800, rc 0) 00000100:00100000:0.0:1787906964.694064:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+15:11371:x1874755972039936:12345-192.168.204.20@tcp:101:lctl.0 Request processed in 447us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906964.694072:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 141 00000100:00100000:3.0:1787906964.766390:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906964.766512:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972040064 00000100:00100000:1.0:1787906964.766524:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972040064 00000100:00100000:1.0:1787906964.766593:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 142 00000100:00100000:1.0:1787906964.766604:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+15:11377:x1874755972040064:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1787906964.766626:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906964.766656:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadc05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef81d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906964.766731:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadc0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906964.767306:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadc0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906964.767326:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadc0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767469:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadc13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767479:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadc13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767486:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadc13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767660:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cadc1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767669:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cadc1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767677:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cadc1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906964.767735:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787906964.767739:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787906964.767765:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cadc1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767777:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadc0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767784:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadc0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767791:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadc0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767797:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906964.767801:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadc0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767808:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadc0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767848:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa510860c00) 00010000:00010000:0.0:1787906964.767864:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906964.767869:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadc0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767875:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadc0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767889:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadc13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767906:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadc13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767912:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadc13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767917:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906964.767920:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadc13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767926:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadc13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767934:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8aa510860a00) 00010000:00010000:0.0:1787906964.767937:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906964.767940:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadc13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767945:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadc13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767980:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadc05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef81d expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.767994:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cadc1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef81d expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.768000:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:0.0:1787906964.768002:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787906964.768011:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f400, rc 0) 00000100:00100000:0.0:1787906964.768086:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+16:11377:x1874755972040064:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1483us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906964.768105:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 142 00000100:00100000:1.0:1787906964.774465:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906964.774566:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972040320 00000100:00100000:0.0:1787906964.774578:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972040320 00000100:00100000:0.0:1787906964.774869:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 143 00000100:00100000:0.0:1787906964.774882:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+16:11377:x1874755972040320:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1787906964.774907:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906964.774929:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cadc21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef824 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.775108:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cadc28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.775125:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cadc28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.775138:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cadc28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.775220:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadc2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.775228:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadc2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.775235:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadc2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787906964.775946:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787906964.776167:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadc36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.776179:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadc36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.776188:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadc36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.776225:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cadc28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.776233:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cadc28 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.776240:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cadc28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.776249:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8ec00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906964.776254:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cadc28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.776262:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cadc28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.776275:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:0.0:1787906964.776279:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906964.776283:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cadc28 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.776289:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cadc28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787906964.776317:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064ff572b reply state 000000002f51dba6 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadc2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906964.776326:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787906964.776371:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cadc21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef824 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.776385:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadc36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef824 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.776391:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860600) 00010000:00010000:0.0:1787906964.776393:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906964.776395:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f800, rc 0) 00000100:00100000:0.0:1787906964.776482:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+19:11377:x1874755972040320:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1602us (2029us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787906964.776491:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 143 00010000:00010000:0.0:1787906964.782140:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadc2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.782158:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadc2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.782167:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadc2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.782173:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906964.782177:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadc2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.782204:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadc2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.782226:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa510860f00) 00010000:00010000:0.0:1787906964.782229:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906964.782233:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadc2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.782240:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadc2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906964.789466:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906964.791117:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972040448 00000100:00100000:2.0:1787906964.791134:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972040448 00000100:00100000:2.0:1787906964.791264:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:2.0:1787906964.791275:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2343:x1874755972040448:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1787906964.791293:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906964.791319:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadc44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef82b expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787906964.791349:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787906964.791369:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=403s v=(0 0) 00010000:00010000:2.0:1787906964.791374:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787906964.791384:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadc44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef82b expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906964.791404:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadc44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef82b expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906964.791443:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96200, rc 0) 00000100:00100000:2.0:1787906964.791523:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2343:x1874755972040448:12345-192.168.204.20@tcp:101:bash.0 Request processed in 250us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906964.791531:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00080000:1.0:1787906964.792893:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787906964.805258:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906964.805414:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972040576 00000100:00100000:3.0:1787906964.805430:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972040576 00000100:00100000:3.0:1787906964.805516:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:3.0:1787906964.805530:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:11377:x1874755972040576:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1787906964.805575:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906964.805601:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef832 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906964.805657:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadc44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef82b expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906964.805667:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906964.805671:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906964.805677:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 7 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906964.805718:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadc44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef82b expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906964.805736:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadc44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef82b expref: 7 pid: 6673 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906964.805753:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fa9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8459:1874756000364544:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906964.805922:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5172530c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787906964.811905:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fa9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8459:1874756000364544:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906964.811954:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 7 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906964.811980:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031a00, rc 0) 00000100:00100000:3.0:1787906964.812114:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+7:11377:x1874755972040576:12345-192.168.204.20@tcp:101:bash.0 Request processed in 6580us (6878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906964.812124:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:1.0:1787906964.812417:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906964.814598:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972040704 00000100:00100000:0.0:1787906964.815085:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972040704 00010000:00010000:0.0:1787906964.815218:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadc44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef82b expref: 7 pid: 6673 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906964.815295:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:0.0:1787906964.815319:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f367100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972040704:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906964.815371:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906964.815427:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadc44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef82b expref: 7 pid: 6673 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.815457:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadc44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef82b expref: 7 pid: 6673 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.815499:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadc44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef82b expref: 7 pid: 6673 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.815582:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787906964.815587:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787906964.815598:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 6 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.815609:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 6 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906964.815678:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 6 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906964.815693:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507d39180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5816:1874756000364672:192.168.204.20@tcp:105: 00000100:00100000:0.0:1787906964.815960:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5012ed180 going to sleep for 11 seconds 00000100:00100000:1.0:1787906964.819898:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507d39180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5816:1874756000364672:192.168.204.20@tcp:105: 00010000:00010000:1.0:1787906964.819926:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906964.819985:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f367100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755972040704:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 4670us (7569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906964.819998:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:1.0:1787906964.822038:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906964.822338:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972040960 00000100:00100000:3.0:1787906964.822370:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972040960 00000100:00100000:3.0:1787906964.822474:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:3.0:1787906964.822487:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+18:11377:x1874755972040960:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:3.0:1787906964.823285:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+19:11377:x1874755972040960:12345-192.168.204.20@tcp:35:bash.0 Request processed in 795us (1252us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787906964.823313:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:0.0:1787906964.923745:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906964.923997:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972041216 00000100:00100000:2.0:1787906964.924008:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972041216 00000100:00100000:2.0:1787906964.924071:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 144 00000100:00100000:2.0:1787906964.924083:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+19:11387:x1874755972041216:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906964.924119:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906964.924140:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadc52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef839 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906964.924253:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787906964.924374:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadc52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef839 expref: 21 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906964.924391:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa510860c00) 00010000:00010000:2.0:1787906964.924395:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787906964.924400:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadc52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef839 expref: 21 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906964.924414:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97a00, rc 0) 00000100:00100000:2.0:1787906964.924488:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+20:11387:x1874755972041216:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 407us (753us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787906964.924513:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 144 00000100:00100000:0.0:1787906964.928854:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906964.928938:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972041472 00000100:00100000:1.0:1787906964.928949:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972041472 00000100:00100000:1.0:1787906964.929011:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:1.0:1787906964.929025:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+20:11387:x1874755972041472:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1787906964.929371:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+21:11387:x1874755972041472:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 348us (526us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787906964.929379:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:1.0:1787906965.022406:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906965.031134:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972041600 00000100:00100000:3.0:1787906965.031154:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972041600 00000100:00100000:3.0:1787906965.031241:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 145 00000100:00100000:3.0:1787906965.031253:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+21:11393:x1874755972041600:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906965.031280:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906965.031301:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadc60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef840 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.031369:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadc67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.031382:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.031393:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906965.031457:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787906965.031474:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906965.031504:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.031532:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadc60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef840 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.031551:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadc67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef840 expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.031560:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:3.0:1787906965.031563:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787906965.031567:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030800, rc 0) 00000100:00100000:3.0:1787906965.031669:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+22:11393:x1874755972041600:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 418us (9275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906965.031676:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 145 00000100:00100000:2.0:1787906965.045901:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906965.048166:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972041856 00000100:00100000:1.0:1787906965.048184:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972041856 00000100:00100000:1.0:1787906965.048336:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 146 00000100:00100000:1.0:1787906965.048349:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+22:11393:x1874755972041856:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1787906965.048371:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906965.048393:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadc6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef847 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.048498:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cadc75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.048512:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cadc75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.048524:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cadc75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906965.048534:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787906965.050238:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadc6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef847 expref: 25 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.050289:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cadc75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef847 expref: 24 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.050299:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860600) 00010000:00010000:1.0:1787906965.050302:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787906965.050305:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211000, rc 0) 00000100:00100000:1.0:1787906965.050397:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+24:11393:x1874755972041856:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 2049us (4510us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787906965.050406:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 146 00000100:00100000:1.0:1787906965.059970:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906965.060274:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972042112 00000100:00100000:3.0:1787906965.060288:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972042112 00000100:00100000:3.0:1787906965.060363:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 147 00000100:00100000:3.0:1787906965.060385:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+24:11393:x1874755972042112:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906965.060482:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906965.060508:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadc83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef84e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.060920:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadc8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.060938:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadc8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.060968:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadc8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906965.060981:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787906965.061116:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadc83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef84e expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.061139:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadc8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef84e expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.061149:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860600) 00010000:00010000:3.0:1787906965.061152:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787906965.061156:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030a00, rc 0) 00000100:00100000:3.0:1787906965.061239:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+26:11393:x1874755972042112:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 866us (1279us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787906965.061249:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 147 00000100:00100000:3.0:1787906965.064797:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906965.071864:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972042240 00000100:00100000:0.0:1787906965.071886:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972042240 00000100:00100000:0.0:1787906965.072071:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:0.0:1787906965.072085:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+26:2343:x1874755972042240:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906965.072114:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906965.072142:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cadc75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef847 expref: 26 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.072167:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860600) 00010000:00010000:0.0:1787906965.072189:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906965.072279:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+25:2343:x1874755972042240:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 196us (7493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906965.072287:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1787906965.083072:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906965.089669:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972042368 00000100:00100000:3.0:1787906965.089689:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972042368 00000100:00100000:3.0:1787906965.089940:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:3.0:1787906965.089957:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755972042368:12345-192.168.204.20@tcp:1:lfs.0 00010000:00010000:3.0:1787906965.090039:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cadc98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.090071:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 6 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.090122:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906965.090129:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787906965.090136:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cadc98 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.090203:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 6 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.090222:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 6 pid: 8459 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906965.090246:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534faa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874756000364800:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906965.090395:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5172530c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787906965.094104:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534faa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874756000364800:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906965.094141:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cadc98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906965.094788:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906965.094898:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972042496 00000100:00100000:0.0:1787906965.094907:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972042496 00002000:00100000:0.0:1787906965.094956:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8aa53b036a00 x1874755972042496/t0(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:536/0 lens 504/0 e 0 to 0 dl 1787906976 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787906965.094967:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa53b036a00 with x1874755972042496 ext(0->12) 00010000:00010000:0.0:1787906965.094975:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 7 pid: 8459 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.096577:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 7 pid: 8459 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787906965.096598:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8aa53b036a00 00000100:00100000:1.0:1787906965.096976:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:1.0:1787906965.097001:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972042496:12345-192.168.204.20@tcp:4:lfs.0 00000100:00100000:1.0:1787906965.098637:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2345:x1874755972042496:12345-192.168.204.20@tcp:4:lfs.0 Request processed in 1639us (3841us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787906965.098651:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00002000:00100000:1.0:1787906965.098664:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8aa53b036a00 x1874755972042496/t4294967305(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:536/0 lens 504/448 e 0 to 0 dl 1787906976 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787906965.098675:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa53b036a00 with x1874755972042496 ext(0->12) 00010000:00010000:1.0:1787906965.098685:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 9 pid: 8459 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.098707:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 9 pid: 8459 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787906965.099019:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8aa53b036a00 00000100:00100000:0.0:1787906965.108499:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906965.111005:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972042624 00000100:00100000:3.0:1787906965.111022:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972042624 00010000:00010000:2.0:1787906965.111227:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 9 pid: 8459 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906965.111281:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:2.0:1787906965.111292:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2346:x1874755972042624:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906965.111308:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787906965.111329:0:8506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787906965.111332:0:8506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787906964 00002000:00010000:2.0:1787906965.111334:0:8506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787906964 00002000:00010000:2.0:1787906965.111337:0:8506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787906964 00010000:00010000:2.0:1787906965.111343:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 9 pid: 8459 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.111361:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 9 pid: 8459 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.111397:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cadc4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef832 expref: 9 pid: 8459 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.111448:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787906965.111456:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787906965.111496:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cadc98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.111512:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cadc98 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.111585:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906965.111707:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972042624:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 415us (3217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906965.111719:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00010000:00010000:3.0:1787906965.112061:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cadc98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.112073:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cadc98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.112124:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cadc98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.112273:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cadc98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.112362:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cadc98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.112369:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030200 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787906965.112373:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cadc98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.112382:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cadc98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.112395:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cadc98 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906965.112401:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cadc98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906965.112909:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972042368:12345-192.168.204.20@tcp:1:lfs.0 Request processed in 22952us (29845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906965.112920:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:0.0:1787906965.119896:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906965.120180:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972042880 00000100:00100000:3.0:1787906965.120213:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972042880 00000100:00100000:3.0:1787906965.120582:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:3.0:1787906965.120610:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52939b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+25:11393:x1874755972042880:12345-192.168.204.20@tcp:35:lfs.0 00000004:00010000:3.0:1787906965.120677:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadc8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef84e expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787906965.122458:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787906965.122559:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787906965.128446:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787906965.128547:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.128569:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadc36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef824 expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.128579:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.128621:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadc36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef824 expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.128639:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadc36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef824 expref: 29 pid: 5830 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906965.128670:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b036d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1874756000364928:192.168.204.20@tcp:104: 00000100:00100000:2.0:1787906965.131181:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5069040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787906965.136944:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906965.137015:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972043008 00000100:00100000:0.0:1787906965.137025:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972043008 00010000:00010000:0.0:1787906965.137068:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadc36 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef824 expref: 30 pid: 5830 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906965.137128:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:0.0:1787906965.137138:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534faa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+30:2346:x1874755972043008:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906965.137152:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906965.137159:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadc36 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef824 expref: 30 pid: 5830 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.137200:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadc36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef824 expref: 30 pid: 5830 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.137223:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860600) 00010000:00010000:0.0:1787906965.137229:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.137238:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.137244:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.137263:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787906965.137326:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadc36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef824 expref: 30 pid: 5830 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906965.137353:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b036d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1874756000364928:192.168.204.20@tcp:104: 00010000:00010000:2.0:1787906965.137387:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.137398:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.137404:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787906965.137555:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787906965.137760:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787906965.137921:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b036d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1874756000365056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787906965.138359:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534faa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+31:2346:x1874755972043008:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 1221us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906965.138370:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:2.0:1787906965.138480:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906965.138601:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000365056 00000100:00100000:0.0:1787906965.138619:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000365056 00000100:00100000:2.0:1787906965.138741:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5069049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787906965.139014:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787906965.139024:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874756000365056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787906965.139117:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874756000365056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906965.139125:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787906965.139385:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b036d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1874756000365056:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787906965.139997:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787906965.140081:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b036d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1874756000365184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787906965.140144:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906965.140182:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5069040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787906965.140313:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000365184 00000100:00100000:3.0:1787906965.140321:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000365184 00000100:00100000:3.0:1787906965.140366:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787906965.140383:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1874756000365184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787906965.140569:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5834:x1874756000365184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 196us (424us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787906965.140576:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787906965.140677:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b036d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1874756000365184:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787906965.140802:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787906965.140914:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.140926:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.140933:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.140940:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906965.140944:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.140952:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.140967:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860600) 00010000:00010000:2.0:1787906965.140970:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787906965.140976:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.140982:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadc9f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787906965.141162:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787906965.141584:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1787906965.141596:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 403413783429ns, next at 404413781636ns, rc = 0 00000001:00080000:2.0:1787906965.141604:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787906965.141639:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860600) 00010000:00010000:2.0:1787906965.141643:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787906965.141659:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadc8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef84e expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906965.142058:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52939b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+32:11393:x1874755972042880:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 21449us (22172us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787906965.142068:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00000020:00080000:2.0:1787906965.142073:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787906965.148338:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906965.149880:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972043136 00000100:00100000:0.0:1787906965.149895:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972043136 00000100:00100000:0.0:1787906965.149971:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 148 00000100:00100000:0.0:1787906965.149983:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+32:11393:x1874755972043136:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1787906965.150023:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906965.150048:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cadca6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef855 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.150123:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cadca6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef855 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.150139:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cadca6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef855 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.150159:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:0.0:1787906965.150163:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787906965.150166:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8e200, rc 0) 00000100:00100000:0.0:1787906965.150250:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+33:11393:x1874755972043136:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 269us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906965.150258:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 148 00010000:00010000:3.0:1787906965.152398:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906965.159976:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906965.160150:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972043392 00000100:00100000:0.0:1787906965.160161:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972043392 00000100:00100000:0.0:1787906965.160229:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:0.0:1787906965.160241:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+33:11393:x1874755972043392:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1787906965.160646:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+34:11393:x1874755972043392:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 405us (677us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787906965.160656:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00000001:00080000:0.0:1787906965.215508:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000001:00080000:0.0:1787906965.215540:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967421 is committed 00000001:00080000:0.0:1787906965.215553:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967431 is committed 00000004:00080000:0.0:1787906965.215558:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787906965.215598:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa5069049c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787906965.215603:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa52ec13000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa506904600 00000020:00080000:0.0:1787906965.215606:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa52ec13900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa5347b4000 00000020:00080000:2.0:1787906965.215737:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787906965.215928:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787906965.216256:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000365312:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787906965.216333:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906965.216502:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000365312 00000100:00100000:1.0:1787906965.216509:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000365312 00000100:00100000:1.0:1787906965.216564:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787906965.216573:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874756000365312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787906965.216597:0:6675:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1787906965.216760:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a914b94, atime: 0x6a914b94, ctime: 0x6a914b94, blocks: 0x1 00010000:00010000:1.0:1787906965.216769:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061da8e92/0x72bb6cf063cadcad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.216787:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1787906965.216791:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787906965.216798:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061da8e92/0x72bb6cf063cadcad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.216838:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061da8e92/0x72bb6cf063cadcad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.216848:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061da8e92/0x72bb6cf063cadcad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.216856:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061da8e92/0x72bb6cf063cadcad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.216890:0:6675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787906965.217157:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787906965.217164:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061da8e92/0x72bb6cf063cadcad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.217173:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787906965.217177:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061da8e92/0x72bb6cf063cadcad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.217187:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061da8e92/0x72bb6cf063cadcad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.217203:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061da8e92/0x72bb6cf063cadcad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.217210:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061da8e92/0x72bb6cf063cadcad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.217227:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906965.217229:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906965.217236:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906965.217690:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874756000365312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1115us (1354us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787906965.217698:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1787906965.217880:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa510b82300/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787906965.217888:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000365312:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787906965.277688:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906965.277932:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972043648 00000100:00100000:3.0:1787906965.277944:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972043648 00000100:00100000:3.0:1787906965.278014:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 149 00000100:00100000:3.0:1787906965.278026:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+17:11403:x1874755972043648:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906965.278058:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906965.278093:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadcb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef85c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906965.278560:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787906965.282433:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadcb4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef85c expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.282458:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa510860c00) 00010000:00010000:2.0:1787906965.282461:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787906965.282467:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadcb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef85c expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.282483:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030200, rc 0) 00000100:00100000:2.0:1787906965.282988:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+18:11403:x1874755972043648:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 4961us (5308us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1787906965.282997:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 149 00000100:00100000:3.0:1787906965.292339:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906965.293669:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972043776 00000100:00100000:0.0:1787906965.293683:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972043776 00000100:00100000:0.0:1787906965.293742:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 150 00000100:00100000:0.0:1787906965.293753:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+18:11403:x1874755972043776:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:0.0:1787906965.293879:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadcc2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.293898:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadcc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.293908:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadcc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.293923:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.293929:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.293935:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.295673:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadcd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.295694:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.295707:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787906965.295775:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.295794:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadcc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.295801:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadcc2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.295810:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadcc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.295928:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906965.295932:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadcc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.295941:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadcc2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.295958:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:0.0:1787906965.295962:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906965.295967:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadcc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.295982:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadcc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.296002:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.296009:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.296219:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.296225:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906965.296228:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.296234:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.296243:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa510860e00) 00010000:00010000:0.0:1787906965.296245:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906965.296249:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.296255:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.296558:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.296568:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadcd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.296582:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadcd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.296588:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906965.296591:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadcd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.296597:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadcd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.296606:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:0.0:1787906965.296608:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906965.296612:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadcd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.296618:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadcd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906965.296725:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+18:11403:x1874755972043776:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 2967us (4388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906965.296735:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 150 00000100:00100000:1.0:1787906965.299942:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906965.300042:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972044032 00000100:00100000:0.0:1787906965.300056:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972044032 00000100:00100000:0.0:1787906965.300131:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:0.0:1787906965.300143:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+18:11403:x1874755972044032:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1787906965.300735:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+19:11403:x1874755972044032:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 591us (803us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787906965.300744:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:2.0:1787906965.369423:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906965.369764:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972044288 00000100:00100000:0.0:1787906965.369776:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972044288 00000100:00100000:0.0:1787906965.369889:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 151 00000100:00100000:0.0:1787906965.369902:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+19:11406:x1874755972044288:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1787906965.369930:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906965.369957:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadcd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef863 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.370049:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcde lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.370065:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.370077:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.370105:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadce5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.370112:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.370119:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378373:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadcec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378396:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadcec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378410:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadcec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906965.378425:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787906965.378550:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378559:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378566:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378571:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906965.378575:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378584:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378612:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:1.0:1787906965.378615:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906965.378620:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378627:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadcde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378641:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378647:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadce5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378653:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadce5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378658:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906965.378661:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadce5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378667:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadce5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378674:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa510860e00) 00010000:00010000:1.0:1787906965.378676:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906965.378679:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadce5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378685:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadce5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378753:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadcd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef863 expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378768:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadcec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef863 expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.378776:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:1.0:1787906965.378778:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787906965.378780:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508210600, rc 0) 00000100:00100000:1.0:1787906965.381135:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+21:11406:x1874755972044288:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 11223us (11709us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787906965.381147:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 151 00000100:00100000:3.0:1787906965.389470:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906965.389847:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972044416 00000100:00100000:1.0:1787906965.389859:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972044416 00000100:00100000:1.0:1787906965.389943:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 152 00000100:00100000:1.0:1787906965.389956:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+21:11406:x1874755972044416:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1787906965.390045:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadcfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.390068:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadcfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.390095:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadcfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.390131:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadcfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.390153:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadcfa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.390161:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadcfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.390167:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906965.390173:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadcfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.390181:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadcfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.390196:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:1.0:1787906965.390200:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787906965.390207:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadcfa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.390214:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadcfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906965.390460:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+21:11406:x1874755972044416:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 504us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906965.390470:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 152 00000100:00100000:2.0:1787906965.405621:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906965.405744:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972044672 00000100:00100000:1.0:1787906965.405758:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972044672 00000100:00100000:1.0:1787906965.405884:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:1.0:1787906965.405898:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+21:11406:x1874755972044672:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1787906965.406283:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+22:11406:x1874755972044672:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 387us (696us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787906965.406591:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:2.0:1787906965.514586:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906965.514639:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906965.514670:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906965.514726:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906965.514761:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972045184 00000100:00100000:2.0:1787906965.514770:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972045184 00000100:00100000:2.0:1787906965.514881:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:2.0:1787906965.514893:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755972045184:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906965.514967:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2346:x1874755972045184:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906965.514975:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:0.0:1787906965.515182:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972045056 00000100:00100000:0.0:1787906965.515187:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972045056 00000100:00100000:0.0:1787906965.515230:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972044928 00000100:00100000:0.0:1787906965.515234:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972044928 00000100:00100000:0.0:1787906965.515252:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00100000:0.0:1787906965.515258:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755972045056:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906965.515314:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2346:x1874755972045056:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 55us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906965.515326:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00100000:0.0:1787906965.515340:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 102 00000100:00100000:0.0:1787906965.515347:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972044928:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906965.515375:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972044928:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906965.515386:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 102 00000100:00080000:2.0:1787906965.516261:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787906965.516402:0:11686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972044800 00000100:00100000:3.0:1787906965.516411:0:11686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972044800 00000100:00100000:3.0:1787906965.516476:0:11686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 306 00000100:00100000:3.0:1787906965.516485:0:11686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755972044800:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906965.516552:0:11686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755972044800:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 68us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906965.516559:0:11686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 306 00000100:00100000:2.0:1787906965.772154:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906965.773001:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972045440 00000100:00100000:1.0:1787906965.773015:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972045440 00000100:00100000:1.0:1787906965.773103:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 153 00000100:00100000:1.0:1787906965.773115:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+22:11437:x1874755972045440:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:1.0:1787906965.773141:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906965.773164:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadd01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef86a expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.773283:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadd08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.773298:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadd08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.773312:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadd08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906965.773324:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787906965.774646:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadd01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef86a expref: 25 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.774674:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadd08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef86a expref: 24 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.774683:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:1.0:1787906965.774686:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787906965.774690:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211e00, rc 0) 00000100:00100000:1.0:1787906965.777114:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+24:11437:x1874755972045440:12345-192.168.204.20@tcp:101:cat.0 Request processed in 3987us (4957us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787906965.777129:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 153 00000100:00100000:2.0:1787906965.785650:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906965.785792:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906965.785891:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972045824 00000100:00100000:1.0:1787906965.785903:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972045824 00000100:00100000:1.0:1787906965.786054:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1787906965.786066:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+24:2343:x1874755972045824:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906965.786095:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906965.786120:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cadd08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef86a expref: 24 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.786138:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:1.0:1787906965.786142:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906965.786204:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+23:2343:x1874755972045824:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 140us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906965.786212:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:0.0:1787906965.786985:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972045696 00000100:00100000:0.0:1787906965.786994:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972045696 00000100:00100000:0.0:1787906965.787344:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:0.0:1787906965.787356:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+23:11437:x1874755972045696:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:0.0:1787906965.787726:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+24:11437:x1874755972045696:12345-192.168.204.20@tcp:35:cat.0 Request processed in 372us (2086us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787906965.787734:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:2.0:1787906965.897561:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906965.897646:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972046080 00000100:00100000:0.0:1787906965.897657:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972046080 00000100:00100000:0.0:1787906965.897725:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 154 00000100:00100000:0.0:1787906965.897737:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+24:11443:x1874755972046080:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1787906965.897764:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906965.897767:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787906965.897797:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadc67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef840 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.897851:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:0.0:1787906965.897869:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787906965.897885:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cadd16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef871 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.898508:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.898526:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadcec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef863 expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.898535:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.898929:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadcec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef863 expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.898947:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadcec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef863 expref: 24 pid: 5830 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906965.898972:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507d38000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000365440:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906965.899104:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5012ed180 going to sleep for 11 seconds 00000100:00100000:0.0:1787906965.903571:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906965.903742:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972046208 00000100:00100000:1.0:1787906965.903762:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972046208 00010000:00010000:1.0:1787906965.903839:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadcec lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef863 expref: 25 pid: 5830 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906965.903878:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:1.0:1787906965.903889:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510226850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+25:2345:x1874755972046208:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906965.903905:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906965.903913:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadcec lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef863 expref: 25 pid: 5830 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.903957:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadcec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef863 expref: 25 pid: 5830 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.903984:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:1.0:1787906965.903990:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.904000:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.904006:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906965.904026:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906965.904404:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510226850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+25:2345:x1874755972046208:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 516us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906965.904412:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00010000:00010000:2.0:1787906965.905255:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadcec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef863 expref: 24 pid: 5830 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906965.905282:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507d38000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000365440:192.168.204.20@tcp:104: 00010000:00010000:2.0:1787906965.905307:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.905318:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.905324:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906965.905344:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787906965.905508:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8ec00/0x72bb6cf063cadd16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef871 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.905524:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef871 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906965.905533:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:2.0:1787906965.905535:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787906965.905538:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f800, rc 0) 00000100:00100000:2.0:1787906965.907780:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+24:11443:x1874755972046080:12345-192.168.204.20@tcp:101:dd.0 Request processed in 7973us (8156us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787906965.907828:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 154 00000100:00100000:2.0:1787906965.910362:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906965.910422:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972046464 00000100:00100000:0.0:1787906965.910433:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972046464 00000100:00100000:0.0:1787906965.910499:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 155 00000100:00100000:0.0:1787906965.910511:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+24:11443:x1874755972046464:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:0.0:1787906965.911344:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadd2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.911388:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadd2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.911474:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadd2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787906965.911536:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1787906965.911563:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f76c60b5 reply state 000000006fd70a3c transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadd2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906965.911572:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787906965.912378:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+27:11443:x1874755972046464:12345-192.168.204.20@tcp:36:dd.0 Request processed in 1863us (2093us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787906965.912389:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 155 00000020:00080000:1.0:1787906965.912394:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787906965.918384:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadd2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.918404:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadd2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.918413:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadd2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.918419:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906965.918424:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadd2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.918433:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadd2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.918455:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:0.0:1787906965.918457:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906965.918462:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadd2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906965.918489:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadd2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.175958:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906966.176190:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787906966.176215:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000365696:0@lo:400:kworker.0 00000100:00100000:2.0:1787906966.176273:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000365824:0@lo:400:kworker.0 00000100:00100000:0.0:1787906966.176329:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874756000366080:0@lo:400:kworker.0 00000100:00100000:2.0:1787906966.178930:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000365952:0@lo:400:kworker.0 00000100:00100000:2.0:1787906966.179016:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906966.180825:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906966.184339:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000365696 00000100:00100000:3.0:1787906966.184356:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000365696 00000100:00100000:3.0:1787906966.184412:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787906966.184423:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000365696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906966.184504:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906966.184517:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000365696:12345-0@lo:400:kworker.0 Request processed in 96us (3714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906966.184524:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787906966.184540:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000366080 00000100:00100000:3.0:1787906966.184543:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000366080 00000100:00100000:0.0:1787906966.184558:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1787906966.184562:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906966.184569:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000366208:0@lo:400:kworker.0 00000100:00100000:3.0:1787906966.184587:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787906966.184593:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874756000366080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906966.184600:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906966.184620:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874756000366080:12345-0@lo:400:kworker.0 Request processed in 28us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906966.184626:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787906966.184669:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000365952 00000100:00100000:0.0:1787906966.184673:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000365952 00000100:00100000:0.0:1787906966.184703:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000366208 00000100:00100000:0.0:1787906966.184706:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000366208 00000100:00100000:0.0:1787906966.184730:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787906966.184736:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874756000365952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906966.184772:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874756000365952:12345-0@lo:400:kworker.0 Request processed in 37us (5757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906966.184794:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787906966.184807:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787906966.184832:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000366208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906966.184863:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000366208:12345-0@lo:400:kworker.0 Request processed in 33us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906966.184869:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787906966.184884:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000365696:0@lo:400:kworker.0 00000100:00100000:3.0:1787906966.184904:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa52f365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000365568:0@lo:400:kworker.0 00000100:00100000:3.0:1787906966.184933:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906966.184990:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000365568 00000100:00100000:3.0:1787906966.184994:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000365568 00000100:00100000:3.0:1787906966.185019:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787906966.185025:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3302:x1874756000365568:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787906966.185030:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787906966.185033:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906966.185053:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000366208:0@lo:400:kworker.0 00000100:00100000:3.0:1787906966.185058:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3302:x1874756000365568:12345-0@lo:400:kworker.0 Request processed in 33us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906966.185063:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874756000366080:0@lo:400:kworker.0 00000100:00100000:3.0:1787906966.185064:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787906966.185136:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906966.185185:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa52f365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000365568:0@lo:400:kworker.0 00000100:00100000:3.0:1787906966.185209:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000365952:0@lo:400:kworker.0 00000100:00100000:3.0:1787906966.185238:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000365824 00000100:00100000:3.0:1787906966.185241:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000365824 00000100:00100000:3.0:1787906966.185266:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787906966.185271:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000365824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906966.185302:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000365824:12345-0@lo:400:kworker.0 Request processed in 30us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906966.185307:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787906966.185326:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000365824:0@lo:400:kworker.0 00000100:00080000:0.0:1787906966.185961:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906966.217260:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906966.217550:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972046592 00000100:00100000:3.0:1787906966.217562:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972046592 00000100:00100000:3.0:1787906966.217680:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 156 00000100:00100000:3.0:1787906966.217691:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+26:11458:x1874755972046592:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:3.0:1787906966.217720:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906966.217762:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef878 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.218174:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadd39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.218192:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadd39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.218205:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadd39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.218221:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.218229:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.218236:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.218950:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadd47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.218968:0:10853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef871 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.218976:0:10853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadd47 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.219019:0:10853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef871 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.219048:0:10853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef871 expref: 27 pid: 5832 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906966.219075:0:10853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fa9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000366336:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906966.219655:0:10853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa517253900 going to sleep for 11 seconds 00000100:00080000:2.0:1787906966.221684:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906966.225147:0:10853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fa9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000366336:192.168.204.20@tcp:104: 00010000:00010000:2.0:1787906966.225192:0:10853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadd47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906966.225531:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906966.225639:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972046848 00000100:00100000:3.0:1787906966.225648:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972046848 00000100:00100000:3.0:1787906966.225710:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:3.0:1787906966.225720:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+28:5587:x1874755972046848:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787906966.226378:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+29:5587:x1874755972046848:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 654us (843us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787906966.226388:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:3.0:1787906966.229411:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906966.229527:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972046976 00000100:00100000:2.0:1787906966.229538:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972046976 00010000:00010000:2.0:1787906966.229584:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef871 expref: 29 pid: 5832 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906966.229633:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:2.0:1787906966.229643:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+29:2345:x1874755972046976:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906966.229659:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906966.229666:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef871 expref: 29 pid: 5832 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.229681:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef871 expref: 29 pid: 5832 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.229723:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadd1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef871 expref: 29 pid: 5832 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.229743:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:2.0:1787906966.229748:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadd47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.229757:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadd47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.229765:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadd47 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.229800:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906966.229906:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+28:2345:x1874755972046976:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 264us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906966.229914:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00010000:00010000:3.0:1787906966.230217:0:10853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadd47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230226:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadd47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906966.230523:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787906966.230527:0:10853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906966.230548:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadd47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230562:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadd47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230587:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadd39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230594:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadd39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230601:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadd39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230607:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906966.230611:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadd39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230618:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadd39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230630:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:3.0:1787906966.230633:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906966.230637:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadd39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230643:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadd39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230655:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230660:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230666:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230679:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906966.230683:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230689:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230697:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa5069caa00) 00010000:00010000:3.0:1787906966.230700:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906966.230702:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230708:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230749:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef878 expref: 28 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230762:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadd47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef878 expref: 27 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.230770:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:3.0:1787906966.230772:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787906966.230775:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030a00, rc 0) 00000100:00100000:3.0:1787906966.232307:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+27:11458:x1874755972046592:12345-192.168.204.20@tcp:101:stat.0 Request processed in 13540us (14115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906966.232323:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 156 00000001:00080000:0.0:1787906966.279967:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1787906966.279996:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:3.0:1787906966.298422:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906966.298509:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972047232 00000100:00100000:0.0:1787906966.298520:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972047232 00000100:00100000:0.0:1787906966.298582:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 157 00000100:00100000:0.0:1787906966.298598:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+27:11464:x1874755972047232:12345-192.168.204.20@tcp:36:truncate.0 00010000:00010000:0.0:1787906966.298704:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906966.298754:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadd47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef878 expref: 27 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906966.298787:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:0.0:1787906966.298793:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787906966.299511:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadd4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906966.299529:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadd4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906966.299539:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadd4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787906966.299599:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787906966.299629:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004de9f315 reply state 00000000193b9a44 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadd4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906966.299637:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787906966.301930:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+29:11464:x1874755972047232:12345-192.168.204.20@tcp:36:truncate.0 Request processed in 3327us (3510us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787906966.301946:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 157 00000020:00080000:2.0:1787906966.301955:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787906966.311217:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadd4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906966.311265:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadd4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906966.311273:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadd4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906966.311280:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906966.311286:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadd4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906966.311294:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadd4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906966.311317:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:0.0:1787906966.311321:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906966.311326:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadd4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906966.311332:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadd4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906966.465539:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906966.472847:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972047360 00000100:00100000:0.0:1787906966.472875:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972047360 00000100:00100000:2.0:1787906966.473503:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 158 00000100:00100000:2.0:1787906966.473515:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+28:11478:x1874755972047360:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:2.0:1787906966.473539:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906966.473564:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadd55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef87f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.473661:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cadd5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.473674:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cadd5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.473685:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cadd5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.473712:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadd63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.473720:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadd63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.473726:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadd63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474113:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474123:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474131:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906966.474182:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787906966.474187:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906966.474213:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474236:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474245:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cadd5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474253:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cadd5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474260:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cadd5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474265:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906966.474269:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cadd5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474277:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cadd5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474289:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906966.474293:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906966.474297:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cadd5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474303:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cadd5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474316:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadd63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474322:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadd63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474334:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadd63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474340:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96c00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906966.474342:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadd63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474349:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadd63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474357:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa5069aa700) 00010000:00010000:2.0:1787906966.474359:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906966.474362:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadd63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474367:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadd63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474399:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadd55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef87f expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474423:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef87f expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.474431:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:2.0:1787906966.474433:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787906966.474436:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97a00, rc 0) 00000100:00100000:2.0:1787906966.474512:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+29:11478:x1874755972047360:12345-192.168.204.20@tcp:101:stat.0 Request processed in 999us (8993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906966.474532:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 158 00000100:00100000:2.0:1787906966.597492:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906966.597785:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972047616 00000100:00100000:3.0:1787906966.597797:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972047616 00000100:00100000:3.0:1787906966.597880:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 159 00000100:00100000:3.0:1787906966.597891:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+29:11488:x1874755972047616:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906966.597911:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906966.597929:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906966.598183:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787906966.598345:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd71 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef886 expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.598360:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa510860c00) 00010000:00010000:3.0:1787906966.598364:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787906966.598369:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef886 expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.598383:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030000, rc 0) 00000100:00100000:3.0:1787906966.598470:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+30:11488:x1874755972047616:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 581us (988us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1787906966.598478:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 159 00000100:00100000:0.0:1787906966.605644:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906966.607169:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972047872 00000100:00100000:2.0:1787906966.607183:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972047872 00000100:00100000:2.0:1787906966.607314:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:2.0:1787906966.607327:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52939ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+30:11488:x1874755972047872:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1787906966.608182:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52939ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+31:11488:x1874755972047872:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 853us (2542us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787906966.608193:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:1.0:1787906966.676383:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906966.676479:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972048128 00000100:00100000:3.0:1787906966.676490:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972048128 00000100:00100000:3.0:1787906966.676558:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 160 00000100:00100000:3.0:1787906966.676569:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+31:11494:x1874755972048128:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1787906966.676594:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906966.676627:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd7f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef88d expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.676747:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.676766:0:10853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef87f expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.676775:0:10853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.676856:0:10853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef87f expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.676871:0:10853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef87f expref: 32 pid: 5832 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906966.676888:0:10853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fa8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000366464:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906966.676997:0:10853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787906966.682671:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906966.682847:0:10853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fa8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000366464:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906966.682882:0:10853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906966.686292:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972048256 00000100:00100000:2.0:1787906966.686310:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972048256 00010000:00010000:2.0:1787906966.686375:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef87f expref: 33 pid: 5832 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906966.686500:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:2.0:1787906966.686512:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+33:2346:x1874755972048256:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906966.686529:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906966.686536:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef87f expref: 33 pid: 5832 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.686550:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef87f expref: 33 pid: 5832 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.686584:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef87f expref: 33 pid: 5832 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.686630:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:2.0:1787906966.686636:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.686645:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.686653:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.686686:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906966.686772:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+32:2346:x1874755972048256:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 262us (4112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906966.686780:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00010000:00010000:3.0:1787906966.687886:0:10853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.687901:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906966.687938:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787906966.688121:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd7f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef88d expref: 33 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.688143:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef88d expref: 32 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.688152:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:3.0:1787906966.688155:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787906966.688158:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030200, rc 0) 00000100:00100000:3.0:1787906966.688227:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+32:11494:x1874755972048128:12345-192.168.204.20@tcp:101:bash.0 Request processed in 11659us (11865us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1787906966.688236:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 160 00000100:00100000:3.0:1787906966.689594:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000366592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787906966.689661:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906966.690675:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000366592 00000100:00100000:2.0:1787906966.690696:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000366592 00000100:00100000:2.0:1787906966.690766:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787906966.690779:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000366592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787906966.690844:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906966.691091:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000366592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 314us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906966.691100:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787906966.691631:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000366592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787906966.696549:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906966.696641:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972048512 00000100:00100000:3.0:1787906966.696652:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972048512 00000100:00100000:3.0:1787906966.697884:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 161 00000100:00100000:3.0:1787906966.697906:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+32:11494:x1874755972048512:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:3.0:1787906966.698210:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.698228:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.698258:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787906966.698318:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1787906966.698344:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb8899c3 reply state 00000000bbaf8d1e transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906966.698352:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787906966.698450:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+35:11494:x1874755972048512:12345-192.168.204.20@tcp:36:bash.0 Request processed in 554us (1910us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787906966.698459:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 161 00000020:00080000:3.0:1787906966.698463:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787906966.704966:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.704989:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.704997:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.705003:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906966.705009:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.705016:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.705034:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:3.0:1787906966.705036:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906966.705067:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.705074:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadd94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906966.715417:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906966.715506:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972048640 00000100:00100000:2.0:1787906966.715520:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972048640 00000100:00100000:2.0:1787906966.715591:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 162 00000100:00100000:2.0:1787906966.715603:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+34:11494:x1874755972048640:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1787906966.715632:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906966.715668:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef894 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.715754:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadda2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.715768:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef88d expref: 35 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.715776:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadda2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.715860:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef88d expref: 35 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.715875:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef88d expref: 35 pid: 10853 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906966.715889:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000366720:192.168.204.20@tcp:104: 00000100:00100000:2.0:1787906966.715980:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a120c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787906966.724076:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906966.724401:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000366720:192.168.204.20@tcp:104: 00010000:00010000:2.0:1787906966.724435:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadda2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906966.724635:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972048768 00000100:00100000:1.0:1787906966.724642:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972048768 00010000:00010000:1.0:1787906966.724678:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef88d expref: 36 pid: 10853 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906966.724720:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:1.0:1787906966.724746:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+36:2346:x1874755972048768:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906966.724762:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906966.724770:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef88d expref: 36 pid: 10853 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906966.724785:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef88d expref: 36 pid: 10853 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906966.724859:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadd86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef88d expref: 36 pid: 10853 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906966.724877:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:1.0:1787906966.724882:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadda2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906966.724893:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906966.724901:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadda2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906966.724947:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906966.725006:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+35:2346:x1874755972048768:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 261us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906966.725013:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00010000:00010000:3.0:1787906966.725725:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.725736:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906966.725790:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787906966.725795:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906966.725856:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.725892:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadd9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef894 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.726032:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadda2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef894 expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.726041:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:3.0:1787906966.726044:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787906966.726047:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96a00, rc 0) 00000100:00100000:3.0:1787906966.726458:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+34:11494:x1874755972048640:12345-192.168.204.20@tcp:101:bash.0 Request processed in 10855us (11056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906966.726468:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 162 00000100:00100000:0.0:1787906966.739288:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906966.739434:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972049024 00000100:00100000:1.0:1787906966.739445:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972049024 00000100:00100000:1.0:1787906966.739521:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:1.0:1787906966.739533:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+34:11494:x1874755972049024:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:1.0:1787906966.739854:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+35:11494:x1874755972049024:12345-192.168.204.20@tcp:35:bash.0 Request processed in 322us (773us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787906966.739862:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:0.0:1787906966.809549:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906966.810442:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972049280 00000100:00100000:2.0:1787906966.810453:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972049280 00000100:00100000:2.0:1787906966.810515:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 163 00000100:00100000:2.0:1787906966.810532:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+35:11504:x1874755972049280:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906966.810555:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906966.810590:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadda9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef89b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906966.810845:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787906966.810995:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadda9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef89b expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.811010:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa510860c00) 00010000:00010000:2.0:1787906966.811013:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787906966.811018:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadda9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef89b expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.811031:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96c00, rc 0) 00000100:00100000:2.0:1787906966.811111:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+36:11504:x1874755972049280:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 587us (1575us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787906966.811119:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 163 00000100:00100000:0.0:1787906966.814510:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906966.814652:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972049408 00000100:00100000:3.0:1787906966.814664:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972049408 00000100:00100000:3.0:1787906966.814890:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 164 00000100:00100000:3.0:1787906966.814902:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+36:11504:x1874755972049408:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:3.0:1787906966.814988:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063caddb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815008:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063caddb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815023:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063caddb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815039:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815045:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815052:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815456:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063caddc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815466:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063caddc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815473:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063caddc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787906966.815518:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063caddc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815543:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063caddb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815560:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063caddb7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815566:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063caddb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815572:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906966.815575:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063caddb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815582:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063caddb7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815594:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:3.0:1787906966.815597:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906966.815601:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063caddb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815646:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063caddb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815660:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815665:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815671:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815675:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906966.815684:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815696:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815704:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa5069ca000) 00010000:00010000:3.0:1787906966.815706:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906966.815709:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815715:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815728:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063caddc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815734:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063caddc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815739:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063caddc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815743:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906966.815745:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063caddc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815750:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063caddc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815756:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:3.0:1787906966.815759:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906966.815768:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063caddc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906966.815774:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063caddc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906966.816317:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+36:11504:x1874755972049408:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 1413us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906966.816339:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 164 00000100:00100000:0.0:1787906966.824076:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906966.824441:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972049664 00000100:00100000:1.0:1787906966.824451:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972049664 00000100:00100000:1.0:1787906966.824512:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:1.0:1787906966.824522:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+36:11504:x1874755972049664:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1787906966.825695:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+37:11504:x1874755972049664:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 1169us (1637us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787906966.825706:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:1.0:1787906966.892932:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906966.893043:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972049920 00000100:00100000:2.0:1787906966.893063:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972049920 00000100:00100000:2.0:1787906966.893187:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 165 00000100:00100000:2.0:1787906966.893201:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+37:11507:x1874755972049920:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906966.893227:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906966.893249:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063caddcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef8a2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.893346:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063caddd3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.893361:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063caddd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.893388:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063caddd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.893404:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063caddda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.893412:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063caddda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.893419:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063caddda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.893799:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadde1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.893809:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadde1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.893852:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadde1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906966.893862:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787906966.893954:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063caddd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.893962:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063caddd3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.893968:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063caddd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.893974:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906966.893985:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063caddd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.893993:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063caddd3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.894006:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906966.894008:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906966.894013:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063caddd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.894019:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063caddd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.894031:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063caddda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.894038:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063caddda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.894043:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063caddda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.894049:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906966.894068:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063caddda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.894075:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063caddda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.894083:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa5069aa700) 00010000:00010000:2.0:1787906966.894085:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906966.894094:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063caddda lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.894100:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063caddda lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.894145:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063caddcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8a2 expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.894158:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadde1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8a2 expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.894165:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:2.0:1787906966.894168:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787906966.894170:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97800, rc 0) 00000100:00100000:2.0:1787906966.894246:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+39:11507:x1874755972049920:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1049us (1324us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787906966.894255:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 165 00000100:00100000:0.0:1787906966.901035:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906966.901102:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972050048 00000100:00100000:2.0:1787906966.901116:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972050048 00000100:00100000:0.0:1787906966.901184:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906966.901255:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972050176 00000100:00100000:1.0:1787906966.901260:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972050176 00000100:00100000:1.0:1787906966.901331:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:1.0:1787906966.901341:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+40:2344:x1874755972050176:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906966.901358:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906966.901383:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadde1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8a2 expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906966.901401:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:1.0:1787906966.901406:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906966.901458:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+39:2344:x1874755972050176:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 118us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906966.901465:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:2.0:1787906966.902469:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:2.0:1787906966.902486:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+38:11507:x1874755972050048:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:2.0:1787906966.902688:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063caddef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.902704:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063caddef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.902714:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063caddef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.902764:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063caddef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.902772:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063caddef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.902779:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063caddef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.902785:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96c00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906966.902791:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063caddef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.902799:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063caddef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.902879:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:2.0:1787906966.902883:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787906966.902888:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063caddef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906966.902895:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063caddef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906966.903014:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+38:11507:x1874755972050048:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 534us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906966.903023:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:0.0:1787906966.914017:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906966.915940:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972050432 00000100:00100000:2.0:1787906966.915956:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972050432 00000100:00100000:2.0:1787906966.916032:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:2.0:1787906966.916069:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+38:11507:x1874755972050432:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1787906966.916481:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+39:11507:x1874755972050432:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 412us (2471us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787906966.916490:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:0.0:1787906967.078742:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906967.078956:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972050688 00000100:00100000:3.0:1787906967.078968:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972050688 00000100:00100000:3.0:1787906967.079027:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 167 00000100:00100000:3.0:1787906967.079037:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+39:11525:x1874755972050688:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:3.0:1787906967.079073:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906967.079097:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063caddf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef8a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.079202:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddfd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.079216:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.079227:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906967.079239:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787906967.079534:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063caddf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8a9 expref: 42 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.079555:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8a9 expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.079577:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:3.0:1787906967.079580:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787906967.079584:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030800, rc 0) 00000100:00100000:3.0:1787906967.079644:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+41:11525:x1874755972050688:12345-192.168.204.20@tcp:101:cat.0 Request processed in 608us (913us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787906967.079652:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 167 00000100:00100000:3.0:1787906967.122656:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906967.122842:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972050816 00000100:00100000:2.0:1787906967.122852:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972050816 00000100:00100000:2.0:1787906967.122913:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 168 00000100:00100000:2.0:1787906967.122924:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+41:11526:x1874755972050816:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906967.122946:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906967.122967:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef8b0 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.123033:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cade12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.123057:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cade12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.123068:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cade12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906967.123254:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787906967.123258:0:10853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906967.123328:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cade12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.123359:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8b0 expref: 43 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.123391:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cade12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8b0 expref: 42 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.123401:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906967.123404:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787906967.123407:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97000, rc 0) 00000100:00100000:2.0:1787906967.123489:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+42:11526:x1874755972050816:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 566us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906967.123498:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 168 00000100:00100000:0.0:1787906967.128221:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906967.128463:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972051200 00000100:00100000:3.0:1787906967.128476:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972051200 00000100:00100000:3.0:1787906967.128539:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:3.0:1787906967.128552:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+42:11526:x1874755972051200:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1787906967.128979:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+43:11526:x1874755972051200:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 429us (768us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787906967.128989:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:0.0:1787906967.131901:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906967.131999:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972051328 00000100:00100000:1.0:1787906967.132016:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972051328 00000100:00100000:1.0:1787906967.132086:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:1.0:1787906967.132097:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+43:11526:x1874755972051328:12345-192.168.204.20@tcp:103:lfs.0 00010000:00010000:1.0:1787906967.132112:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787906967.132137:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadda2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef894 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.132158:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063caddfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8a9 expref: 42 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.132171:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cadca6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef855 expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.132181:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860f00) 00010000:00010000:1.0:1787906967.132192:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906967.132249:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+40:11526:x1874755972051328:12345-192.168.204.20@tcp:103:lfs.0 Request processed in 153us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906967.132257:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:0.0:1787906967.135549:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906967.139799:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972051456 00000100:00100000:3.0:1787906967.139823:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972051456 00000100:00100000:3.0:1787906967.139902:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 169 00000100:00100000:3.0:1787906967.139911:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+40:11526:x1874755972051456:12345-192.168.204.20@tcp:58:lfs.0 00010000:00010000:3.0:1787906967.140013:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cade19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.140031:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cade19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.140043:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cade19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787906967.140427:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787906967.140834:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+40:11526:x1874755972051456:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 921us (5292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906967.140844:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 169 00000100:00100000:0.0:1787906967.182237:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906967.183548:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972051584 00000100:00100000:2.0:1787906967.183562:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972051584 00000100:00100000:2.0:1787906967.183639:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 170 00000100:00100000:2.0:1787906967.183649:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+40:11528:x1874755972051584:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906967.183671:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906967.183702:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef8b7 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.183772:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.183787:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.184662:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.184692:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.184715:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.184722:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185212:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cade35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185222:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cade35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185230:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cade35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906967.185270:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787906967.185275:0:10853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906967.185294:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cade35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185305:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cade35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185314:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185320:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade27 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185327:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185341:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906967.185346:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185353:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185365:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906967.185368:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906967.185372:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185378:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185391:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185397:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185403:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185408:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906967.185411:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185417:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185439:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa5069aa700) 00010000:00010000:2.0:1787906967.185441:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906967.185444:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185449:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185483:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8b7 expref: 42 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185496:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cade35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8b7 expref: 41 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.185502:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:2.0:1787906967.185505:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787906967.185507:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96000, rc 0) 00000100:00100000:2.0:1787906967.186031:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+41:11528:x1874755972051584:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 2380us (3802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906967.186040:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 170 00010000:00010000:0.0:1787906967.200973:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787906967.264129:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787906967.264143:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787906967.264181:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787906967.264188:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787906967.264313:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534faa680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874756000366848:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787906967.264430:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787906967.266700:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534faa680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874756000366848:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787906967.268331:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906967.268555:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972051712 00000100:00100000:2.0:1787906967.268569:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972051712 00000100:00100000:2.0:1787906967.268616:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 171 00000100:00100000:2.0:1787906967.268627:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+41:11536:x1874755972051712:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787906967.268657:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787906967.268794:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+41:11536:x1874755972051712:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 168us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906967.268838:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 171 00000100:00100000:0.0:1787906967.280390:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906967.280486:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972051840 00000100:00100000:3.0:1787906967.280497:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972051840 00000100:00100000:3.0:1787906967.280574:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 172 00000100:00100000:3.0:1787906967.280585:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+41:11536:x1874755972051840:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787906967.280657:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade3c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.280675:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.280697:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.280757:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade43 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.280783:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.280790:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.280847:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.280856:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.280863:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906967.280906:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787906967.280910:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906967.280924:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.280936:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.280943:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade3c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.280950:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.280956:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906967.280962:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.280977:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade3c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.280990:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa518965b00) 00010000:00010000:3.0:1787906967.280993:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906967.280998:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade3c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281004:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade3c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281019:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281025:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade43 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281032:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281036:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906967.281039:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281056:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade43 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281070:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906967.281073:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906967.281076:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade43 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281094:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade43 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281110:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281119:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281126:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281131:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906967.281134:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281140:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281146:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:3.0:1787906967.281148:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906967.281151:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.281156:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906967.281232:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+41:11536:x1874755972051840:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 647us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906967.281240:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 172 00000100:00100000:0.0:1787906967.292355:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906967.292453:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972052096 00000100:00100000:2.0:1787906967.292462:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972052096 00000100:00100000:2.0:1787906967.292516:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 173 00000100:00100000:2.0:1787906967.292526:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+41:11536:x1874755972052096:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787906967.292548:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906967.292578:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef8be expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.292674:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.292698:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.292711:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906967.292723:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787906967.292874:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.292882:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.292888:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.292894:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906967.292898:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.292921:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.292935:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:2.0:1787906967.292938:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787906967.292941:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.292947:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.292989:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade51 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8be expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.293000:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa518965b00) 00010000:00010000:2.0:1787906967.293002:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787906967.293005:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8be expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.293013:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96c00, rc 0) 00000100:00100000:2.0:1787906967.293339:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+42:11536:x1874755972052096:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 812us (992us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1787906967.293347:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 173 00000100:00100000:0.0:1787906967.296626:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906967.296721:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972052224 00000100:00100000:3.0:1787906967.296733:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972052224 00000100:00100000:3.0:1787906967.296800:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 174 00000100:00100000:3.0:1787906967.296848:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+42:11536:x1874755972052224:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787906967.296892:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787906967.297031:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+42:11536:x1874755972052224:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 221us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906967.297038:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 174 00000100:00100000:0.0:1787906967.305933:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906967.306220:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972052480 00000100:00100000:3.0:1787906967.306231:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972052480 00000100:00100000:3.0:1787906967.306291:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:3.0:1787906967.306300:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+42:11536:x1874755972052480:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787906967.306319:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906967.306322:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787906967.306346:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cade12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8b0 expref: 42 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.306366:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:3.0:1787906967.306371:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787906967.306382:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef8c5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787906967.307536:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787906967.307843:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.307863:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.307888:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.307963:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8c5 expref: 44 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.307982:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8c5 expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.307990:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906967.307993:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787906967.307997:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030800, rc 0) 00000100:00100000:3.0:1787906967.312380:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+43:11536:x1874755972052480:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 6065us (6443us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787906967.312394:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:0.0:1787906967.334716:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906967.334854:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972052736 00000100:00100000:3.0:1787906967.334866:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972052736 00000100:00100000:3.0:1787906967.334930:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 176 00000100:00100000:3.0:1787906967.334941:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+43:11536:x1874755972052736:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787906967.335005:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906967.335035:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cade6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8c5 expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335074:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787906967.335236:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787906967.335261:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335289:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335299:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335317:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x150f86e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335324:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x150f86e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335332:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x150f86e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335645:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335653:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335660:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335665:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906967.335671:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335679:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335690:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:3.0:1787906967.335699:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906967.335704:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335710:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cade7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335721:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x150f86e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335727:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x150f86e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335732:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x150f86e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335736:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906967.335739:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x150f86e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335745:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x150f86e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335751:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x150f86e1 (ffff8aa5069ca500) 00010000:00010000:3.0:1787906967.335754:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906967.335757:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x150f86e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.335761:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cade82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x150f86e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906967.335920:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+42:11536:x1874755972052736:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 978us (1216us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787906967.335934:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 176 00000100:00100000:3.0:1787906967.338689:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906967.341995:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972052864 00000100:00100000:2.0:1787906967.342010:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972052864 00000100:00100000:2.0:1787906967.342146:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 177 00000100:00100000:2.0:1787906967.342158:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+42:11536:x1874755972052864:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787906967.342190:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906967.342214:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef8cc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.342249:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.342263:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.342274:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.342431:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8cc expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.342450:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8cc expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.342457:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:2.0:1787906967.342460:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787906967.342464:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97600, rc 0) 00000100:00100000:2.0:1787906967.342594:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+43:11536:x1874755972052864:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 437us (3917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906967.342602:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 177 00000100:00100000:3.0:1787906967.348459:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906967.348765:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972053120 00000100:00100000:2.0:1787906967.348778:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972053120 00000100:00100000:2.0:1787906967.348879:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 178 00000100:00100000:2.0:1787906967.348894:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+43:11536:x1874755972053120:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787906967.348988:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.349005:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.349017:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787906967.349402:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1787906967.349413:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 405621599720ns, next at 406621596834ns, rc = 0 00000004:00010000:2.0:1787906967.349497:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a2a3067 reply state 00000000a21cac65 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906967.349508:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787906967.349597:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+45:11536:x1874755972053120:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 705us (1148us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1787906967.349605:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 178 00010000:00010000:2.0:1787906967.352070:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.352090:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.352099:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.352105:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906967.352110:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.352137:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.352157:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:2.0:1787906967.352161:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787906967.352166:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.352172:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cade97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906967.354554:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906967.354701:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972053248 00000100:00100000:2.0:1787906967.354714:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972053248 00000100:00100000:2.0:1787906967.354783:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 179 00000100:00100000:2.0:1787906967.354794:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+44:11536:x1874755972053248:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787906967.354841:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906967.354863:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef8d3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.354938:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8d3 expref: 45 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.354955:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8d3 expref: 45 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.354978:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:2.0:1787906967.354981:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787906967.354986:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96c00, rc 0) 00000100:00100000:2.0:1787906967.355079:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+45:11536:x1874755972053248:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 286us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906967.355087:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 179 00000100:00100000:1.0:1787906967.362592:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906967.362707:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972053376 00000100:00100000:2.0:1787906967.362719:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972053376 00000100:00100000:2.0:1787906967.362791:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:2.0:1787906967.362802:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755972053376:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787906967.363218:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972053376:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 417us (636us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787906967.363227:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00080000:1.0:1787906967.363420:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787906967.366995:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906967.367102:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972053632 00000100:00100000:3.0:1787906967.367112:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972053632 00000100:00100000:3.0:1787906967.367168:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:3.0:1787906967.367177:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+45:11536:x1874755972053632:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787906967.367405:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+46:11536:x1874755972053632:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 228us (420us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787906967.367412:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:3.0:1787906967.373359:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906967.375982:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972053888 00000100:00100000:2.0:1787906967.376001:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972053888 00000100:00100000:2.0:1787906967.376079:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 180 00000100:00100000:2.0:1787906967.376092:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+46:11536:x1874755972053888:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787906967.376234:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+46:11536:x1874755972053888:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 144us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906967.376242:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 180 00000100:00100000:1.0:1787906967.384958:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906967.385062:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972054016 00000100:00100000:2.0:1787906967.385074:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972054016 00000100:00100000:2.0:1787906967.385142:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 181 00000100:00100000:2.0:1787906967.385154:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+46:11536:x1874755972054016:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787906967.385178:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906967.385198:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cadea5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef8da expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.385276:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadeac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.385300:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadeac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.385315:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadeac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906967.385371:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906967.385393:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadeac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.385424:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cadea5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8da expref: 48 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.385440:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadeac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8da expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.385448:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:2.0:1787906967.385451:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787906967.385455:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96e00, rc 0) 00000100:00100000:2.0:1787906967.385529:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+47:11536:x1874755972054016:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 376us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906967.385536:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 181 00000100:00100000:1.0:1787906967.394999:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906967.395102:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972054144 00000100:00100000:2.0:1787906967.395116:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972054144 00000100:00100000:2.0:1787906967.395189:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:2.0:1787906967.395204:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972054144:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787906967.395227:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906967.395271:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadeb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef8e1 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787906967.395309:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a914b97, blocks: 0x1 00010000:00010000:2.0:1787906967.395333:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=405s v=(0 0) 00010000:00010000:2.0:1787906967.395338:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787906967.395347:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadeb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e1 expref: 8 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.395364:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadeb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e1 expref: 8 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.395376:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96200, rc 0) 00000100:00100000:2.0:1787906967.395439:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972054144:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 237us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906967.395446:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:3.0:1787906967.406067:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906967.406183:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972054400 00000100:00100000:2.0:1787906967.406195:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972054400 00000100:00100000:2.0:1787906967.406262:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 182 00000100:00100000:2.0:1787906967.406273:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+47:11536:x1874755972054400:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787906967.406448:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+47:11536:x1874755972054400:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 176us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906967.406456:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 182 00000100:00100000:0.0:1787906967.412848:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906967.414296:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972054528 00000100:00100000:2.0:1787906967.414312:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972054528 00000100:00100000:2.0:1787906967.414423:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:2.0:1787906967.414435:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+8:11536:x1874755972054528:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787906967.414468:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906967.414489:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f6c41ec/0x72bb6cf063cadeba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef8e8 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.414522:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadeb3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e1 expref: 9 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.414531:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787906967.414536:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787906967.414541:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f6c41ec/0x72bb6cf063cadeba lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e8 expref: 9 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.414578:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadeb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e1 expref: 9 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.414592:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadeb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e1 expref: 9 pid: 6674 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906967.414607:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1874756000366976:192.168.204.20@tcp:104: 00000100:00100000:2.0:1787906967.414725:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a120c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787906967.423901:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1874756000366976:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906967.423951:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f6c41ec/0x72bb6cf063cadeba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e8 expref: 9 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.423981:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97400, rc 0) 00000100:00100000:3.0:1787906967.424071:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+9:11536:x1874755972054528:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 9636us (11265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906967.424082:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:3.0:1787906967.425749:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906967.425863:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972054656 00000100:00100000:1.0:1787906967.425873:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972054656 00010000:00010000:1.0:1787906967.425929:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadeb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e1 expref: 9 pid: 6674 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906967.426006:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:1.0:1787906967.426018:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2346:x1874755972054656:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906967.426052:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906967.426083:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadeb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e1 expref: 9 pid: 6674 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.426099:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadeb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e1 expref: 9 pid: 6674 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.426127:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055d9d6d2/0x72bb6cf063cadeb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e1 expref: 9 pid: 6674 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.426146:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787906967.426151:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787906967.426160:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f6c41ec/0x72bb6cf063cadeba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e8 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.426171:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f6c41ec/0x72bb6cf063cadeba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e8 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.426221:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003f6c41ec/0x72bb6cf063cadeba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e8 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906967.426239:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5817:1874756000367104:192.168.204.20@tcp:105: 00000100:00100000:1.0:1787906967.426358:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507205840 going to sleep for 11 seconds 00000100:00100000:1.0:1787906967.430522:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5817:1874756000367104:192.168.204.20@tcp:105: 00010000:00010000:1.0:1787906967.430553:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906967.430632:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972054656:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 4615us (4897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906967.430644:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:3.0:1787906967.431962:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906967.432054:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972054784 00000100:00100000:1.0:1787906967.432064:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972054784 00002000:00100000:1.0:1787906967.432110:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8aa534faa300 x1874755972054784/t0(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:538/0 lens 504/0 e 0 to 0 dl 1787906978 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787906967.432121:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa534faa300 with x1874755972054784 ext(0->8) 00002000:00010000:1.0:1787906967.432127:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa534faa300 00000100:00100000:1.0:1787906967.432160:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:1.0:1787906967.432170:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2345:x1874755972054784:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787906967.432610:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+10:2345:x1874755972054784:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 Request processed in 440us (654us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787906967.432619:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00002000:00100000:1.0:1787906967.432627:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8aa534faa300 x1874755972054784/t4294967314(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:538/0 lens 504/448 e 0 to 0 dl 1787906978 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787906967.432635:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa534faa300 with x1874755972054784 ext(0->8) 00002000:00010000:1.0:1787906967.432639:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa534faa300 00000100:00100000:1.0:1787906967.445987:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906967.446078:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972054912 00000100:00100000:2.0:1787906967.446090:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972054912 00000100:00100000:2.0:1787906967.446163:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 183 00000100:00100000:2.0:1787906967.446176:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+47:11536:x1874755972054912:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787906967.494909:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000100:00100000:0.0:1787906967.495063:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+41:11536:x1874755972054912:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 48869us (49070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906967.495078:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 183 00000001:00080000:2.0:1787906967.495610:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967452 is committed 00000001:00080000:2.0:1787906967.495629:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1787906967.495634:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:3.0:1787906967.496274:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000367232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787906967.496355:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906967.496436:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000367232 00000100:00100000:1.0:1787906967.496446:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000367232 00000100:00100000:1.0:1787906967.496505:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787906967.496524:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000367232:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1787906967.496594:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1787906967.496608:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00002000:00010000:1.0:1787906967.496785:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787906967.496789:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787906967 00002000:00010000:1.0:1787906967.496792:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787906967.496794:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787906967 -> 1787906967 00002000:00010000:1.0:1787906967.496796:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000020:00080000:3.0:1787906967.496858:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787906967.496870:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787906967.497765:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874756000367232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1237us (1402us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787906967.497781:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787906967.497840:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000004:00080000:1.0:1787906967.497860:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa507cc9180/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787906967.497870:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000367232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787906967.497874:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972055040 00000100:00100000:0.0:1787906967.497882:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972055040 00000100:00100000:0.0:1787906967.497931:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:0.0:1787906967.497940:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+10:2346:x1874755972055040:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787906967.601436:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1787906967.601485:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1787906967.601789:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972055040:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 103830us (103960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906967.601802:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:3.0:1787906967.607247:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906967.607327:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972055296 00000100:00100000:1.0:1787906967.607353:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972055296 00000100:00100000:1.0:1787906967.607431:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00100000:1.0:1787906967.607443:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+18:11536:x1874755972055296:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787906967.607512:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906967.607546:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadeac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8da expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.607571:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:1.0:1787906967.607576:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787906967.607616:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadec1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.607631:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.607641:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787906967.608055:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006aeffce9 reply state 00000000ad03c99e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906967.608068:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787906967.608194:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+19:11536:x1874755972055296:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 752us (961us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787906967.608203:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00100000:3.0:1787906967.611786:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906967.611867:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972055424 00000100:00100000:3.0:1787906967.611880:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972055424 00000100:00100000:3.0:1787906967.611948:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:3.0:1787906967.611961:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534e25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972055424:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787906967.612318:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787906967.612323:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787906967 -> 1787906966 00002000:00010000:3.0:1787906967.612326:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787906964 00002000:00010000:3.0:1787906967.612328:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787906967 -> 1787906966 00002000:00010000:3.0:1787906967.612331:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787906967.613021:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534e25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972055424:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 1055us (1244us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787906967.613033:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00010000:00010000:1.0:1787906967.613269:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.613285:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadec1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.613294:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadec1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.613301:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906967.613308:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadec1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.613317:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadec1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.613347:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:1.0:1787906967.613351:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906967.613356:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadec1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.613364:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cadec1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906967.617121:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906967.617389:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972055680 00000100:00100000:1.0:1787906967.617405:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972055680 00000100:00100000:1.0:1787906967.617500:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 185 00000100:00100000:1.0:1787906967.617514:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+18:11536:x1874755972055680:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787906967.617604:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.617623:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8cc expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.617633:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.617673:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8cc expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.617688:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8cc expref: 18 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906967.617707:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874756000367360:192.168.204.20@tcp:104: 00000100:00100000:1.0:1787906967.617846:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53afb0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787906967.625480:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906967.626177:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874756000367360:192.168.204.20@tcp:104: 00010000:00010000:1.0:1787906967.626207:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906967.627653:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972055808 00000100:00100000:2.0:1787906967.627667:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972055808 00010000:00010000:2.0:1787906967.627726:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8cc expref: 19 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906967.627784:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:2.0:1787906967.627796:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510226050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+19:2345:x1874755972055808:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906967.627857:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906967.627867:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8cc expref: 19 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.627881:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8cc expref: 19 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.627908:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cade90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8cc expref: 19 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.627927:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:2.0:1787906967.627933:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.627944:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.627975:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.628016:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787906967.628087:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.628103:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906967.628116:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510226050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+18:2345:x1874755972055808:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 321us (2650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906967.628131:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00010000:00010000:3.0:1787906967.628152:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.628161:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.628169:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.628176:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906967.628182:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.628190:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.628201:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:3.0:1787906967.628205:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787906967.628209:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.628215:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadec8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906967.628267:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+17:11536:x1874755972055680:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 Request processed in 10755us (11162us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787906967.628276:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 185 00000100:00100000:3.0:1787906967.635109:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906967.636807:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972055936 00000100:00100000:1.0:1787906967.636866:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972055936 00000100:00100000:1.0:1787906967.636979:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:1.0:1787906967.636992:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508201f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2343:x1874755972055936:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787906967.637068:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ffb43eb2/0x72bb6cf063cadecf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.637097:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f6c41ec/0x72bb6cf063cadeba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e8 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.637106:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787906967.637112:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787906967.637119:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb43eb2/0x72bb6cf063cadecf lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.637169:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f6c41ec/0x72bb6cf063cadeba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e8 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.637186:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f6c41ec/0x72bb6cf063cadeba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e8 expref: 8 pid: 6675 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906967.637205:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1874756000367488:192.168.204.20@tcp:104: 00000100:00100000:1.0:1787906967.637335:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53afb0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787906967.642759:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1874756000367488:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906967.642956:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ffb43eb2/0x72bb6cf063cadecf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906967.645159:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906967.645219:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972056064 00000100:00100000:0.0:1787906967.645230:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972056064 00010000:00010000:0.0:1787906967.645283:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f6c41ec/0x72bb6cf063cadeba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e8 expref: 9 pid: 6675 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906967.645394:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:0.0:1787906967.645405:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508202680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2346:x1874755972056064:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906967.645423:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906967.645448:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f6c41ec/0x72bb6cf063cadeba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e8 expref: 9 pid: 6675 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.645462:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f6c41ec/0x72bb6cf063cadeba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e8 expref: 9 pid: 6675 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.645484:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f6c41ec/0x72bb6cf063cadeba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8e8 expref: 9 pid: 6675 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.645502:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787906967.645506:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787906967.645512:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffb43eb2/0x72bb6cf063cadecf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.645523:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb43eb2/0x72bb6cf063cadecf lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.645558:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906967.645620:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508202680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972056064:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 218us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906967.645628:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00010000:00010000:3.0:1787906967.645768:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ffb43eb2/0x72bb6cf063cadecf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.645794:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffb43eb2/0x72bb6cf063cadecf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.645850:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ffb43eb2/0x72bb6cf063cadecf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.645859:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb43eb2/0x72bb6cf063cadecf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.645867:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffb43eb2/0x72bb6cf063cadecf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.645875:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211000 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787906967.645880:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb43eb2/0x72bb6cf063cadecf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.645889:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb43eb2/0x72bb6cf063cadecf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.645915:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffb43eb2/0x72bb6cf063cadecf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.645922:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffb43eb2/0x72bb6cf063cadecf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906967.645996:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508201f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2343:x1874755972055936:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 9006us (10897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906967.646005:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:3.0:1787906967.650649:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906967.650787:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972056320 00000100:00100000:1.0:1787906967.650798:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972056320 00000100:00100000:1.0:1787906967.650894:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 186 00000100:00100000:1.0:1787906967.650906:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+17:11536:x1874755972056320:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787906967.651004:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063caded6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.651055:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063caded6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.651069:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063caded6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.651364:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.651378:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8d3 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.651387:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.651428:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8d3 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.651446:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8d3 expref: 18 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906967.651464:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa541c1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000367616:192.168.204.20@tcp:104: 00000100:00100000:1.0:1787906967.651579:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53afb00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787906967.660915:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa541c1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000367616:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906967.660956:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906967.663057:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906967.666800:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972056448 00000100:00100000:1.0:1787906967.666842:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972056448 00010000:00010000:1.0:1787906967.666896:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8d3 expref: 19 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906967.666940:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:1.0:1787906967.666966:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+19:2345:x1874755972056448:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906967.666987:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906967.666996:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8d3 expref: 19 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.667012:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8d3 expref: 19 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.667052:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cade9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8d3 expref: 19 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.667073:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:1.0:1787906967.667078:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.667090:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.667107:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906967.667139:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906967.667211:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+18:2345:x1874755972056448:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 248us (4178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906967.667219:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00010000:00010000:0.0:1787906967.667341:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.667351:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787906967.667780:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1787906967.667944:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787906967.667987:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1787906967.668078:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874756000367744:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787906967.668138:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906967.668176:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5069040c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787906967.668329:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000367744 00000100:00100000:1.0:1787906967.668338:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000367744 00000100:00100000:1.0:1787906967.668387:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787906967.668396:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1874756000367744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787906967.668492:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1874756000367744:12345-0@lo:1000:mdt00_002.0 Request processed in 97us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906967.668499:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787906967.668775:0:5832:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1787906967.668781:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa507cc9180, transno 4294967315 00000100:00100000:0.0:1787906967.668801:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874756000367744:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787906967.669393:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1787906967.669475:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874756000367872:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787906967.669537:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906967.670836:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa506904c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787906967.671056:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000367872 00000100:00100000:1.0:1787906967.671067:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000367872 00000100:00100000:1.0:1787906967.671206:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787906967.671219:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1874756000367872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787906967.671522:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1874756000367872:12345-0@lo:1000:mdt00_002.0 Request processed in 305us (1983us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787906967.671530:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787906967.672341:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874756000367872:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787906967.672409:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672432:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672440:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672447:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906967.672452:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672459:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672482:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa5069aa700) 00010000:00010000:0.0:1787906967.672485:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787906967.672490:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672496:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210000/0x72bb6cf063cadedd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672536:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cade19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672543:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cade19 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672549:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cade19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672886:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906967.672898:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cade19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672905:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cade19 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672915:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:0.0:1787906967.672918:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787906967.672921:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cade19 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672927:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cade19 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672953:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672968:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cade35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8b7 expref: 21 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.672980:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.673033:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cade35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8b7 expref: 21 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.673064:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cade35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8b7 expref: 21 pid: 10853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906967.673082:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cc8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000368000:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906967.675070:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa506904c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787906967.695218:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906967.696801:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972056576 00000100:00100000:3.0:1787906967.696831:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972056576 00010000:00010000:3.0:1787906967.696877:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cade35 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8b7 expref: 22 pid: 10853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906967.696923:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:3.0:1787906967.696933:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+22:2346:x1874755972056576:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787906967.696948:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906967.696956:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cade35 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8b7 expref: 22 pid: 10853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.696971:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cade35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8b7 expref: 22 pid: 10853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.696994:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:3.0:1787906967.697007:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.697017:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.697025:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.697054:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906967.697119:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+22:2346:x1874755972056576:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 187us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906967.697127:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00010000:00010000:0.0:1787906967.699985:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cade35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8b7 expref: 21 pid: 10853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906967.700012:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cc8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000368000:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906967.700056:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700068:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700074:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700088:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700095:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700383:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700389:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906967.700394:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700401:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700417:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:0.0:1787906967.700420:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906967.700434:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700440:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadee4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700455:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063caded6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700461:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063caded6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700467:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063caded6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700473:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906967.700476:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063caded6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700482:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063caded6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700490:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:0.0:1787906967.700493:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787906967.700496:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063caded6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906967.700501:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210a00/0x72bb6cf063caded6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906967.700836:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+20:11536:x1874755972056320:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 49904us (50172us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787906967.700849:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 186 00000020:00080000:0.0:1787906967.700861:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787906967.701459:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787906967.701465:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787906967.702003:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787906967.702013:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787906967.706093:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906967.706255:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972056832 00000100:00100000:3.0:1787906967.706267:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972056832 00000100:00100000:3.0:1787906967.706331:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:3.0:1787906967.706343:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa529399c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+20:11536:x1874755972056832:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787906967.707266:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787906967.707364:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787906967.707416:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadeeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.707437:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadeeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.707452:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadeeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.707464:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadeeb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.707483:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadeeb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.707490:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadeeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906967.707517:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787906967.707670:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787906967.707679:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadeeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.707688:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030000 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787906967.707692:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadeeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.707701:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadeeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.707716:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa5069ca500) 00010000:00010000:2.0:1787906967.707720:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787906967.707725:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadeeb lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.707730:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadeeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906967.707764:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906967.707766:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906967.707768:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906967.708256:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa529399c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+22:11536:x1874755972056832:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 1907us (2166us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787906967.708267:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00000020:00080000:3.0:1787906967.708275:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787906968.231875:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787906968.231991:0:12523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787906968.231998:0:12523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787906968.232060:0:12523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787906968.232072:0:12523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787906968.482928:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906968.483627:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972057088 00000100:00100000:2.0:1787906968.483641:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972057088 00000100:00100000:2.0:1787906968.484148:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 187 00000100:00100000:2.0:1787906968.484164:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+22:11549:x1874755972057088:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906968.484191:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906968.484213:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadef2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef8ef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.484470:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadef9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.484485:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadef9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.484497:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadef9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906968.484509:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787906968.484798:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadef2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8ef expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.484848:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8ef expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.484858:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906968.484867:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787906968.484871:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96000, rc 0) 00000100:00100000:2.0:1787906968.484990:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+24:11549:x1874755972057088:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 830us (2075us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1787906968.484999:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 187 00000100:00080000:1.0:1787906968.487610:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906968.504297:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906968.504488:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972057216 00000100:00100000:0.0:1787906968.504498:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972057216 00000100:00100000:0.0:1787906968.504602:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 188 00000100:00100000:0.0:1787906968.504613:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+24:11549:x1874755972057216:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:0.0:1787906968.504698:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadf07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.504713:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadf07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.504733:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadf07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.504747:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.504755:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.504761:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505092:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadf15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505101:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadf15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505114:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadf15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787906968.505157:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadf15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505170:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadf07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505177:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadf07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505185:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadf07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505191:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906968.505196:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadf07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505203:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadf07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505215:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:0.0:1787906968.505218:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906968.505222:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadf07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505228:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadf07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505242:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505252:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505258:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505263:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906968.505265:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505271:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505278:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa510860a00) 00010000:00010000:0.0:1787906968.505280:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906968.505282:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505288:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505300:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadf15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505306:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadf15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505312:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadf15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505317:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906968.505323:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadf15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505329:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadf15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505335:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa510860700) 00010000:00010000:0.0:1787906968.505337:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906968.505340:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadf15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.505345:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadf15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906968.505413:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+24:11549:x1874755972057216:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 800us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906968.505421:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 188 00000100:00100000:0.0:1787906968.597150:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906968.597315:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972057472 00000100:00100000:2.0:1787906968.597326:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972057472 00000100:00100000:2.0:1787906968.597391:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 189 00000100:00100000:2.0:1787906968.597401:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+24:11552:x1874755972057472:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906968.597423:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906968.597445:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadf1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef8f6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.597518:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.597531:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.597555:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.597570:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.597577:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.597583:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.597999:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598008:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598015:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906968.598036:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787906968.598131:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598138:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598145:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598151:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906968.598156:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598164:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598176:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906968.598184:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906968.598189:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598205:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598218:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598224:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598230:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598235:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906968.598238:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598244:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598255:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa5069aa200) 00010000:00010000:2.0:1787906968.598257:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906968.598259:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598264:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598302:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadf1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8f6 expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598314:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8f6 expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.598327:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906968.598329:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787906968.598332:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96c00, rc 0) 00000100:00100000:2.0:1787906968.598390:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+26:11552:x1874755972057472:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 990us (1254us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787906968.598397:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 189 00000100:00100000:1.0:1787906968.605763:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906968.605912:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972057600 00000100:00100000:2.0:1787906968.605924:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972057600 00000100:00100000:2.0:1787906968.605994:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 190 00000100:00100000:2.0:1787906968.606006:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+26:11552:x1874755972057600:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:2.0:1787906968.606283:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadf3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.606300:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadf3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.606312:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadf3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.606339:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadf3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.606345:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadf3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.606352:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadf3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.606357:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906968.606377:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadf3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.606385:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadf3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.606397:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906968.606400:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787906968.606405:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadf3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.606411:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadf3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906968.606591:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+26:11552:x1874755972057600:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 586us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906968.606600:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 190 00000100:00100000:0.0:1787906968.609758:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906968.609874:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972057856 00000100:00100000:2.0:1787906968.609884:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972057856 00000100:00100000:2.0:1787906968.609947:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:2.0:1787906968.609958:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+26:11552:x1874755972057856:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1787906968.610208:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+27:11552:x1874755972057856:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 251us (462us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787906968.610215:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:1.0:1787906968.659051:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906968.659167:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972058112 00000100:00100000:2.0:1787906968.659191:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972058112 00000100:00100000:2.0:1787906968.659274:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 191 00000100:00100000:2.0:1787906968.659288:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+27:11085:x1874755972058112:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1787906968.659325:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906968.659372:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadf46 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef8fd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.659515:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.659531:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8f6 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.659552:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.659597:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8f6 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.659614:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8f6 expref: 28 pid: 5831 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906968.659630:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e89180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874756000368128:192.168.204.20@tcp:104: 00000100:00100000:2.0:1787906968.660051:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5012edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906968.670689:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e89180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874756000368128:192.168.204.20@tcp:104: 00010000:00010000:2.0:1787906968.670721:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906968.674644:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906968.675246:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972058240 00000100:00100000:2.0:1787906968.675259:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972058240 00010000:00010000:2.0:1787906968.675305:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8f6 expref: 29 pid: 5831 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906968.675372:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:2.0:1787906968.675383:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+29:2346:x1874755972058240:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906968.675399:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906968.675406:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8f6 expref: 29 pid: 5831 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.675419:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8f6 expref: 29 pid: 5831 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.675440:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8f6 expref: 29 pid: 5831 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.675456:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906968.675461:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.675471:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.675478:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.675511:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906968.675576:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+28:2346:x1874755972058240:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 195us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906968.675583:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00010000:00010000:0.0:1787906968.675857:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.675867:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906968.676458:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787906968.676634:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cadf46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8fd expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.676655:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8fd expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.676681:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:0.0:1787906968.676684:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787906968.676687:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97600, rc 0) 00000100:00100000:0.0:1787906968.676729:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+28:11085:x1874755972058112:12345-192.168.204.20@tcp:101:bash.0 Request processed in 17444us (17694us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787906968.676736:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 191 00000100:00100000:1.0:1787906968.687207:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906968.687314:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972058496 00000100:00100000:0.0:1787906968.687327:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972058496 00000100:00100000:0.0:1787906968.687395:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 192 00000100:00100000:0.0:1787906968.687406:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+28:11085:x1874755972058496:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:0.0:1787906968.687743:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.687766:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.687780:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787906968.689212:0:10853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1787906968.689286:0:10853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e23d382 reply state 00000000e6aea3c1 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906968.689299:0:10853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787906968.689373:0:10853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1787906968.689495:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+32:11085:x1874755972058496:12345-192.168.204.20@tcp:36:bash.0 Request processed in 2087us (2296us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1787906968.689504:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 192 00000020:00080000:1.0:1787906968.689510:0:10853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787906968.693259:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.693292:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.693301:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.693308:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906968.693313:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.693321:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.693340:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906968.693343:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906968.693348:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.693354:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadf5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906968.695881:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906968.696149:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972058624 00000100:00100000:3.0:1787906968.696163:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972058624 00000100:00100000:3.0:1787906968.696222:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 193 00000100:00100000:3.0:1787906968.696233:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+31:11085:x1874755972058624:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1787906968.696260:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906968.696283:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadf62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef904 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.696355:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadf62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef904 expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.696371:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadf62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef904 expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.696406:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:3.0:1787906968.696418:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787906968.696422:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030200, rc 0) 00000100:00100000:3.0:1787906968.696492:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+32:11085:x1874755972058624:12345-192.168.204.20@tcp:101:bash.0 Request processed in 261us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906968.696499:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 193 00000100:00100000:3.0:1787906968.702495:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906968.703059:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972058752 00000100:00100000:0.0:1787906968.703074:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972058752 00000100:00100000:1.0:1787906968.703332:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:1.0:1787906968.703345:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:11085:x1874755972058752:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1787906968.703367:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906968.703390:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cadf69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef90b expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787906968.703419:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a914b96, atime: 0x6a914b94, ctime: 0x6a914b96, blocks: 0xb 00010000:00010000:1.0:1787906968.703442:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1787906968.703448:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787906968.703458:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cadf69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef90b expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906968.703475:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cadf69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef90b expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906968.703489:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508210a00, rc 0) 00000100:00100000:1.0:1787906968.703573:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+8:11085:x1874755972058752:12345-192.168.204.20@tcp:101:bash.0 Request processed in 231us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906968.703580:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:0.0:1787906968.707680:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906968.707916:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972058880 00000100:00100000:2.0:1787906968.707928:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972058880 00002000:00010000:2.0:1787906968.707973:0:6678:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787906968.707979:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa507cc9180 with x1874755972058880 ext(0->18446744073709551615) 00002000:00010000:2.0:1787906968.707993:0:6678:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa507cc9180. 00000100:00100000:2.0:1787906968.708038:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:2.0:1787906968.708050:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2343:x1874755972058880:12345-192.168.204.20@tcp:10:bash.0 00002000:00010000:2.0:1787906968.708380:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787906968.708395:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787906966 -> 1787906968 00002000:00010000:2.0:1787906968.708398:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787906964 -> 1787906964 00002000:00010000:2.0:1787906968.708400:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787906966 -> 1787906968 00002000:00010000:2.0:1787906968.708402:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787906968.708475:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2343:x1874755972058880:12345-192.168.204.20@tcp:10:bash.0 Request processed in 427us (803us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787906968.708483:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00002000:00010000:2.0:1787906968.708488:0:6678:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787906968.708490:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa507cc9180 with x1874755972058880 ext(0->18446744073709551615) 00002000:00010000:2.0:1787906968.708496:0:6678:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa507cc9180. 00000040:00080000:2.0:1787906968.736159:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787906968.736171:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787906968.736213:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787906968.736220:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787906968.818311:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906968.818861:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972059008 00000100:00100000:2.0:1787906968.818873:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972059008 00000100:00100000:2.0:1787906968.819042:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 194 00000100:00100000:2.0:1787906968.819054:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+32:11566:x1874755972059008:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:2.0:1787906968.819151:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.819170:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.819185:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.819201:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.819232:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.819239:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820037:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadf7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820051:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadf7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820060:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadf7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787906968.820127:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadf7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820139:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820145:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820154:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820160:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96c00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906968.820164:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820172:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820193:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906968.820196:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906968.820202:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820208:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadf70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820223:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820229:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820235:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820241:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906968.820244:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820251:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820259:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa5069aa200) 00010000:00010000:2.0:1787906968.820261:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906968.820263:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820268:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadf77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820293:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadf7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820300:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadf7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820306:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadf7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820311:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906968.820314:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadf7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820319:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadf7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820711:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906968.820715:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906968.820719:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadf7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.820726:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cadf7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906968.820885:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+32:11566:x1874755972059008:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 1824us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906968.820895:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 194 00000100:00100000:0.0:1787906968.899732:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906968.899882:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972059264 00000100:00100000:3.0:1787906968.899897:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972059264 00000100:00100000:3.0:1787906968.899970:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 195 00000100:00100000:3.0:1787906968.899982:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+32:11569:x1874755972059264:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906968.900024:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906968.900052:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadf85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef912 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900143:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadf8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900160:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadf8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900173:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadf8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900191:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadf93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900198:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadf93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900204:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadf93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900618:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cadf9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900630:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cadf9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900638:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cadf9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906968.900649:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787906968.900782:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadf8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900790:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadf8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900797:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadf8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900803:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906968.900809:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadf8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900878:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadf8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900893:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:3.0:1787906968.900896:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906968.900901:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadf8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900919:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cadf8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900935:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadf93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900941:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadf93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900947:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadf93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900953:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906968.900956:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadf93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900963:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadf93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900971:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa5069caa00) 00010000:00010000:3.0:1787906968.900974:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906968.900977:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadf93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.900984:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cadf93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.901497:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cadf85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef912 expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.901554:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cadf9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef912 expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906968.901563:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906968.901565:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787906968.901568:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031a00, rc 0) 00000100:00100000:2.0:1787906968.901680:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+34:11569:x1874755972059264:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1699us (1963us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787906968.901690:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 195 00000100:00100000:0.0:1787906968.908895:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906968.909006:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972059392 00000100:00100000:1.0:1787906968.909029:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972059392 00000100:00100000:1.0:1787906968.909094:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 196 00000100:00100000:1.0:1787906968.909107:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+34:11569:x1874755972059392:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1787906968.909183:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906968.909225:0:10853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8fd expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906968.909236:0:10853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906968.909279:0:10853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8fd expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906968.909294:0:10853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8fd expref: 34 pid: 5831 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906968.909321:0:10853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53aca2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000368256:192.168.204.20@tcp:104: 00000100:00100000:1.0:1787906968.909428:0:10853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa501668000 going to sleep for 11 seconds 00000100:00100000:1.0:1787906968.915005:0:10853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53aca2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000368256:192.168.204.20@tcp:104: 00010000:00010000:1.0:1787906968.915047:0:10853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906968.916575:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906968.916765:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972059648 00000100:00100000:2.0:1787906968.916775:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972059648 00000100:00100000:2.0:1787906968.916872:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:2.0:1787906968.916884:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+35:5587:x1874755972059648:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787906968.917283:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+36:5587:x1874755972059648:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 401us (717us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787906968.917291:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:0.0:1787906968.920950:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906968.921081:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972059776 00000100:00100000:3.0:1787906968.921091:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972059776 00010000:00010000:3.0:1787906968.921138:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8fd expref: 36 pid: 5831 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906968.921199:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:3.0:1787906968.921210:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+36:2345:x1874755972059776:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787906968.921229:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906968.921238:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8fd expref: 36 pid: 5831 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.921254:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8fd expref: 36 pid: 5831 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.921282:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cadf4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8fd expref: 36 pid: 5831 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.921315:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:3.0:1787906968.921321:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.921332:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.921340:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906968.921375:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906968.921462:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+35:2345:x1874755972059776:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 251us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906968.921470:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 73 00010000:00010000:0.0:1787906968.922145:0:10853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.922157:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.922193:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.922200:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.922208:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.922215:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906968.922219:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.922227:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.922238:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:0.0:1787906968.922241:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787906968.922244:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906968.922249:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cadfa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906968.922314:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+34:11569:x1874755972059392:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 13210us (13433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906968.922321:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 196 00000100:00100000:0.0:1787906968.926578:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906968.926968:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972060032 00000100:00100000:2.0:1787906968.926983:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972060032 00000100:00100000:2.0:1787906968.927076:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:2.0:1787906968.927090:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+34:11569:x1874755972060032:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1787906968.927409:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+35:11569:x1874755972060032:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 321us (840us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787906968.927418:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:3.0:1787906969.036062:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906969.036866:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972060288 00000100:00100000:0.0:1787906969.036879:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972060288 00000100:00100000:0.0:1787906969.036961:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 197 00000100:00100000:0.0:1787906969.036972:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+35:11580:x1874755972060288:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:0.0:1787906969.037004:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906969.037048:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadfaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef919 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.038025:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadfb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.038049:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadfb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.038062:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadfb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.038080:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadfbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.038088:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadfbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.038095:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadfbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.040046:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cadfc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.040062:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cadfc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.040080:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cadfc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906969.040091:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787906969.040187:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadfb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041348:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadfb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041366:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadfb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041372:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906969.041378:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadfb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041387:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadfb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041413:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:0.0:1787906969.041416:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906969.041421:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadfb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041428:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cadfb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041449:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadfbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041454:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadfbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041472:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadfbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041478:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906969.041480:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadfbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041486:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadfbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041493:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa510860700) 00010000:00010000:0.0:1787906969.041495:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906969.041498:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadfbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041504:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cadfbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041575:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cadfaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef919 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041590:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cadfc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef919 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.041598:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:0.0:1787906969.041600:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906969.041603:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8e200, rc 0) 00000100:00100000:0.0:1787906969.041698:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+37:11580:x1874755972060288:12345-192.168.204.20@tcp:101:cat.0 Request processed in 4727us (5653us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787906969.041715:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 197 00000100:00100000:0.0:1787906969.053966:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.055501:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972060544 00000100:00100000:2.0:1787906969.055534:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972060544 00000100:00100000:2.0:1787906969.055619:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:2.0:1787906969.055630:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+37:11580:x1874755972060544:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:2.0:1787906969.055938:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+38:11580:x1874755972060544:12345-192.168.204.20@tcp:35:cat.0 Request processed in 309us (1986us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787906969.055947:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:1.0:1787906969.090426:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.090533:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972060800 00000100:00100000:2.0:1787906969.090544:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972060800 00000100:00100000:2.0:1787906969.090603:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 198 00000100:00100000:2.0:1787906969.090614:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+38:11581:x1874755972060800:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1787906969.090672:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787906969.090700:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cadfc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef919 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.090723:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cadf9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef912 expref: 37 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.090737:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cadf62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef904 expref: 36 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.090748:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906969.090759:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787906969.090778:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadfd2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.090791:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadfd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.090872:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadfd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.090889:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadfd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.090897:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadfd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.090904:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadfd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.091219:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadfe0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.091457:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadfe0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.091465:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadfe0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787906969.092119:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1787906969.092130:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407364316546ns, next at 408364314474ns, rc = 0 00010000:00010000:2.0:1787906969.092187:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadfe7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.092197:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadfe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.092205:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadfe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093071:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadfe7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093088:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadfe7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093094:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadfe7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093169:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787906969.093195:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadfe0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093202:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadfe0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093208:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadfe0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093214:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906969.093219:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadfe0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093237:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadfe0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093253:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069aa900) 00010000:00010000:2.0:1787906969.093256:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787906969.093261:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadfe0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093281:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadfe0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093306:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadfd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093311:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadfd2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093317:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadfd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093322:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906969.093325:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadfd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093330:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadfd2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093338:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906969.093340:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906969.093342:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadfd2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.093347:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadfd2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787906969.093357:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df860c3f reply state 000000000923e805 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadfd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906969.093365:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787906969.093504:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+37:11581:x1874755972060800:12345-192.168.204.20@tcp:36:rm.0 Request processed in 2886us (3084us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787906969.093514:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 198 00010000:00010000:0.0:1787906969.095214:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787906969.095227:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadfe7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.095237:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96e00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787906969.095241:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadfe7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.095251:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadfe7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.095266:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa5069aa900) 00010000:00010000:0.0:1787906969.095269:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787906969.095274:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadfe7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.095280:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96e00/0x72bb6cf063cadfe7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.095302:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906969.095304:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906969.095306:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906969.099556:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadfd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906969.099578:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadfd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906969.099586:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadfd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906969.099612:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96c00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906969.099617:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadfd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906969.099624:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadfd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906969.099641:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa5069aa200) 00010000:00010000:1.0:1787906969.099644:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906969.099650:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadfd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906969.099657:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cadfd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906969.181018:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.181158:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972061056 00000100:00100000:2.0:1787906969.181172:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972061056 00000100:00100000:2.0:1787906969.181253:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 199 00000100:00100000:2.0:1787906969.181266:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+36:11587:x1874755972061056:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1787906969.181298:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906969.181326:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadfee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef920 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.181495:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadff5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.181513:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadff5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.181526:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadff5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.181544:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cadffc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.181551:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cadffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.181557:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cadffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787906969.182236:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787906969.182407:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae003 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.182424:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.182433:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.182468:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadff5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.182474:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadff5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.182480:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadff5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.182486:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906969.182491:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadff5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.182498:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadff5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.182510:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906969.182513:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906969.182518:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadff5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.182524:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cadff5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787906969.182536:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056b9f8e3 reply state 0000000030040fb8 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cadffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906969.182551:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787906969.182581:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cadfee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef920 expref: 39 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.182595:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef920 expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.182603:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069aad00) 00010000:00010000:2.0:1787906969.182605:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787906969.182608:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96200, rc 0) 00000100:00100000:2.0:1787906969.182674:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+39:11587:x1874755972061056:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1411us (1679us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787906969.182683:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 199 00010000:00010000:2.0:1787906969.187801:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cadffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.187842:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cadffc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.187850:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cadffc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.187856:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906969.187862:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cadffc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.187869:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cadffc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.187920:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906969.187924:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906969.187929:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cadffc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.187936:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cadffc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906969.191176:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906969.191269:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972061184 00000100:00100000:3.0:1787906969.191281:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972061184 00000100:00100000:3.0:1787906969.191367:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:3.0:1787906969.191377:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53aca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2345:x1874755972061184:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1787906969.191395:0:8459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906969.191418:0:8459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae011 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef927 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787906969.191448:0:8459:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787906969.191470:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=407s v=(0 0) 00010000:00010000:3.0:1787906969.191475:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906969.191486:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae011 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef927 expref: 6 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.191506:0:8459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae011 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef927 expref: 6 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.191521:0:8459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030000, rc 0) 00000100:00100000:3.0:1787906969.191601:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53aca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2345:x1874755972061184:12345-192.168.204.20@tcp:101:bash.0 Request processed in 225us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906969.191608:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00080000:1.0:1787906969.191796:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906969.199756:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906969.199851:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972061312 00000100:00100000:3.0:1787906969.199862:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972061312 00000100:00100000:3.0:1787906969.199917:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:3.0:1787906969.199927:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:11587:x1874755972061312:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1787906969.199945:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906969.199983:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef92e expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.200037:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae011 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef927 expref: 7 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.200048:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906969.200053:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906969.200058:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.200098:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae011 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef927 expref: 7 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.200114:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae011 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef927 expref: 7 pid: 8459 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906969.200134:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508201500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6674:1874756000368384:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906969.200259:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787906969.202991:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508201500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6674:1874756000368384:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906969.203036:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.203059:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030a00, rc 0) 00000100:00100000:3.0:1787906969.203125:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:11587:x1874755972061312:12345-192.168.204.20@tcp:101:bash.0 Request processed in 3198us (3387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906969.203150:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:0.0:1787906969.211211:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.211338:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972061440 00000100:00100000:2.0:1787906969.211350:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972061440 00010000:00010000:2.0:1787906969.211396:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae011 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef927 expref: 7 pid: 8459 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906969.211458:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:2.0:1787906969.211469:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2344:x1874755972061440:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906969.211487:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906969.211513:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae011 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef927 expref: 7 pid: 8459 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.211530:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae011 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef927 expref: 7 pid: 8459 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.211555:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae011 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef927 expref: 7 pid: 8459 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.211575:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787906969.211594:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787906969.211616:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.211627:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.211670:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906969.211686:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e89180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5816:1874756000368512:192.168.204.20@tcp:105: 00000100:00100000:2.0:1787906969.211786:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5012edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906969.220287:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e89180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5816:1874756000368512:192.168.204.20@tcp:105: 00010000:00010000:2.0:1787906969.220315:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906969.220387:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2344:x1874755972061440:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 8918us (9189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906969.220400:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:3.0:1787906969.223249:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906969.223368:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972061696 00000100:00100000:1.0:1787906969.223380:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972061696 00000100:00100000:1.0:1787906969.223449:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:1.0:1787906969.223474:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+38:11587:x1874755972061696:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:1.0:1787906969.223931:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+39:11587:x1874755972061696:12345-192.168.204.20@tcp:35:bash.0 Request processed in 469us (692us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787906969.223940:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00010000:00010000:2.0:1787906969.248468:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906969.249093:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000368640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906969.249186:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906969.249750:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000368640 00000100:00100000:0.0:1787906969.249761:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000368640 00000100:00080000:1.0:1787906969.249870:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906969.249880:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787906969.249891:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000368640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787906969.249955:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906969.250045:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000368640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906969.250054:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787906969.250137:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1787906969.250146:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1787906969.250174:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa510b82300, transno 4294967307 00000100:00100000:2.0:1787906969.250206:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000368640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787906969.414629:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906969.414790:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972061824 00000100:00100000:1.0:1787906969.414801:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972061824 00000100:00100000:1.0:1787906969.414912:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 200 00000100:00100000:1.0:1787906969.414921:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+39:11603:x1874755972061824:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1787906969.414946:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906969.414974:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae01f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef935 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906969.415047:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cae026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906969.415061:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cae026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906969.415072:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cae026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906969.415130:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787906969.415134:0:10853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787906969.415156:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cae026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906969.415179:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae01f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef935 expref: 41 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906969.415195:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cae026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef935 expref: 40 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906969.415204:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:1.0:1787906969.415206:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787906969.415210:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211a00, rc 0) 00000100:00100000:1.0:1787906969.415273:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+40:11603:x1874755972061824:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 352us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906969.415286:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 200 00000100:00100000:0.0:1787906969.420092:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.420859:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972062080 00000100:00100000:2.0:1787906969.420871:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972062080 00000100:00100000:2.0:1787906969.420940:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 201 00000100:00100000:2.0:1787906969.420951:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+40:11603:x1874755972062080:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906969.420970:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906969.420991:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae02d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef93c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.421111:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae034 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.421125:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.421139:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906969.421151:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787906969.421312:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae02d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef93c expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.421331:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef93c expref: 42 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.421341:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069aad00) 00010000:00010000:2.0:1787906969.421344:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787906969.421348:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97800, rc 0) 00000100:00100000:2.0:1787906969.421421:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+42:11603:x1874755972062080:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 471us (1338us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787906969.421428:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 201 00000100:00100000:3.0:1787906969.435237:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906969.437869:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.437929:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972062464 00000100:00100000:2.0:1787906969.437956:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972062464 00000100:00100000:2.0:1787906969.438039:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 202 00000100:00100000:2.0:1787906969.438051:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+42:11603:x1874755972062464:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906969.438078:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906969.438099:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae042 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef943 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906969.438132:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972062208 00000100:00100000:1.0:1787906969.438140:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972062208 00010000:00010000:2.0:1787906969.438232:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae049 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906969.438232:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00010000:00010000:2.0:1787906969.438249:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae049 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.438262:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae049 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906969.438273:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:1.0:1787906969.438315:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510226450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+44:2345:x1874755972062208:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906969.438329:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906969.438346:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae034 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef93c expref: 44 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906969.438363:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069aad00) 00010000:00010000:1.0:1787906969.438368:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906969.438455:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510226450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+44:2345:x1874755972062208:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 203us (3223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906969.438464:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00010000:00010000:2.0:1787906969.438488:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae042 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef943 expref: 44 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.438505:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae049 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef943 expref: 43 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.438512:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069aad00) 00010000:00010000:2.0:1787906969.438515:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787906969.438518:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96a00, rc 0) 00000100:00100000:2.0:1787906969.438938:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+43:11603:x1874755972062464:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 888us (1076us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787906969.438946:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 202 00000100:00100000:3.0:1787906969.452897:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906969.453496:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972062592 00000100:00100000:0.0:1787906969.453508:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972062592 00000100:00100000:0.0:1787906969.453582:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:0.0:1787906969.453592:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508202300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+6:2344:x1874755972062592:12345-192.168.204.20@tcp:1:lfs.0 00010000:00010000:0.0:1787906969.453652:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cae057 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.453676:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.453685:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787906969.453689:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787906969.453693:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cae057 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.453730:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.453743:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 6 pid: 6674 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906969.453779:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5170a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8459:1874756000368768:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906969.454457:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa506904240 going to sleep for 11 seconds 00000100:00100000:2.0:1787906969.460265:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906969.460344:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972062720 00000100:00100000:3.0:1787906969.460354:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972062720 00002000:00100000:3.0:1787906969.460409:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8aa535e88700 x1874755972062720/t0(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:540/0 lens 504/0 e 0 to 0 dl 1787906980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787906969.460421:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa535e88700 with x1874755972062720 ext(0->8) 00010000:00010000:3.0:1787906969.460431:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 7 pid: 6674 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.460458:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 7 pid: 6674 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787906969.460467:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8aa535e88700 00000100:00100000:3.0:1787906969.460497:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:3.0:1787906969.460508:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972062720:12345-192.168.204.20@tcp:4:lfs.0 00000100:00100000:3.0:1787906969.461356:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2346:x1874755972062720:12345-192.168.204.20@tcp:4:lfs.0 Request processed in 844us (1101us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787906969.461365:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00002000:00100000:3.0:1787906969.461374:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8aa535e88700 x1874755972062720/t4294967308(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:540/0 lens 504/448 e 0 to 0 dl 1787906980 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787906969.461383:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa535e88700 with x1874755972062720 ext(0->8) 00010000:00010000:3.0:1787906969.461396:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 9 pid: 6674 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.461408:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 9 pid: 6674 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787906969.461415:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8aa535e88700 00000100:00100000:1.0:1787906969.466749:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.466894:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972062848 00000100:00100000:2.0:1787906969.466904:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972062848 00010000:00010000:2.0:1787906969.466955:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 9 pid: 6674 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906969.466997:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:2.0:1787906969.467018:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2345:x1874755972062848:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906969.467033:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787906969.467053:0:8506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787906969.467056:0:8506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787906969 00002000:00010000:2.0:1787906969.467058:0:8506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787906969 00002000:00010000:2.0:1787906969.467060:0:8506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787906969 00010000:00010000:2.0:1787906969.467224:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 9 pid: 6674 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.467241:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 9 pid: 6674 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.467266:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787906969.467271:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787906969.467277:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cae057 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.467287:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cae057 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.467326:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906969.467387:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2345:x1874755972062848:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 370us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906969.467404:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 75 00010000:00010000:0.0:1787906969.470209:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae018 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef92e expref: 8 pid: 6674 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906969.470235:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5170a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8459:1874756000368768:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906969.470266:0:8459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cae057 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.470281:0:8459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cae057 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.470289:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cae057 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.470324:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cae057 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.470333:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cae057 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.470342:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cae057 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.470371:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f800 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787906969.470375:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cae057 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.470384:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cae057 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.470415:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cae057 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.470423:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f52553c/0x72bb6cf063cae057 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906969.470535:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508202300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2344:x1874755972062592:12345-192.168.204.20@tcp:1:lfs.0 Request processed in 16944us (17648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906969.470545:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:1.0:1787906969.474711:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906969.474908:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972063104 00000100:00100000:3.0:1787906969.474921:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972063104 00000100:00100000:3.0:1787906969.474990:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:3.0:1787906969.475011:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52939a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+43:11603:x1874755972063104:12345-192.168.204.20@tcp:35:lfs.0 00000004:00010000:3.0:1787906969.475204:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae049 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef943 expref: 43 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787906969.475487:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787906969.475532:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787906969.476277:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787906969.476334:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.476350:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae003 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef920 expref: 47 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.476358:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.476394:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef920 expref: 47 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.476423:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae003 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef920 expref: 47 pid: 5830 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906969.476437:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508202a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1874756000368896:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906969.476672:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787906969.480886:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508202a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1874756000368896:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906969.480915:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906969.483557:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906969.484503:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972063232 00000100:00100000:3.0:1787906969.484516:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972063232 00010000:00010000:2.0:1787906969.484805:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae003 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef920 expref: 48 pid: 5830 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906969.484959:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:2.0:1787906969.484972:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+48:2345:x1874755972063232:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906969.484994:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906969.485012:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae003 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef920 expref: 48 pid: 5830 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.485028:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef920 expref: 48 pid: 5830 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.485055:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae003 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef920 expref: 48 pid: 5830 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.485082:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069aad00) 00010000:00010000:2.0:1787906969.485088:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.485100:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.485130:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.485163:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906969.485235:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+47:2345:x1874755972063232:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 265us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906969.485242:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00010000:00010000:3.0:1787906969.486379:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.486406:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787906969.486553:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1787906969.486799:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1787906969.487025:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508202a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874756000369024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787906969.487567:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906969.487608:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787906969.487799:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000369024 00000100:00100000:0.0:1787906969.487807:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000369024 00000100:00100000:0.0:1787906969.487901:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787906969.487914:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874756000369024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787906969.488040:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874756000369024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 130us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906969.488048:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787906969.488111:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508202a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874756000369024:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787906969.489219:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787906969.489354:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5170a5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874756000369152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787906969.489417:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906969.489450:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa506904c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787906969.489475:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000369152 00000100:00100000:0.0:1787906969.489482:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000369152 00000100:00100000:0.0:1787906969.489514:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787906969.489757:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874756000369152:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787906969.490235:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1874756000369152:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 712us (815us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787906969.490244:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787906969.491231:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5170a5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874756000369152:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787906969.491316:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787906969.491366:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.491390:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.491397:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.491403:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906969.491407:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.491414:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.491429:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069aad00) 00010000:00010000:3.0:1787906969.491432:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787906969.491437:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.491442:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae05e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787906969.491716:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787906969.491836:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1787906969.491849:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407764035545ns, next at 408764033005ns, rc = 0 00000001:00080000:3.0:1787906969.491855:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1787906969.491892:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069aad00) 00010000:00010000:3.0:1787906969.491895:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787906969.491902:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae049 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef943 expref: 51 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906969.492060:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52939a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+50:11603:x1874755972063104:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 17058us (17360us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1787906969.492318:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00000020:00080000:3.0:1787906969.492323:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787906969.496340:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906969.496421:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972063360 00000100:00100000:3.0:1787906969.496432:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972063360 00000100:00100000:3.0:1787906969.496504:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 203 00000100:00100000:3.0:1787906969.496516:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+50:11603:x1874755972063360:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906969.496617:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906969.496707:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae065 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef94a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.496793:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae065 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef94a expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.496808:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae065 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef94a expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.496865:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:3.0:1787906969.496869:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787906969.496873:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031a00, rc 0) 00000100:00100000:3.0:1787906969.497343:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+51:11603:x1874755972063360:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 827us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906969.497351:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 203 00000100:00100000:0.0:1787906969.502590:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.503201:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972063616 00000100:00100000:2.0:1787906969.503211:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972063616 00000100:00100000:2.0:1787906969.503321:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:2.0:1787906969.503334:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+51:11603:x1874755972063616:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1787906969.503625:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+52:11603:x1874755972063616:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 292us (1044us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787906969.503634:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:0.0:1787906969.620760:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.620891:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972063744 00000100:00100000:2.0:1787906969.620904:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972063744 00000100:00100000:2.0:1787906969.620986:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 204 00000100:00100000:2.0:1787906969.621010:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+52:11613:x1874755972063744:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:2.0:1787906969.621109:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae06c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621144:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae06c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621158:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae06c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621176:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae073 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621199:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621206:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621320:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae07a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621328:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621335:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787906969.621385:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621398:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae06c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621405:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae06c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621413:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae06c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621419:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906969.621424:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae06c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621431:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae06c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621451:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906969.621454:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906969.621459:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae06c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621465:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae06c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621478:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621483:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae073 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621488:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621493:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906969.621496:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621501:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae073 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621506:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906969.621508:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906969.621510:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae073 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621515:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae073 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621537:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621542:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae07a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621547:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae07a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621551:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906969.621553:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae07a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621557:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae07a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621564:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:2.0:1787906969.621566:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906969.621568:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae07a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.621573:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae07a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906969.621727:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+52:11613:x1874755972063744:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 728us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906969.621736:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 204 00000100:00100000:0.0:1787906969.670879:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.670992:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972064000 00000100:00100000:2.0:1787906969.671015:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972064000 00000100:00100000:2.0:1787906969.671111:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 205 00000100:00100000:2.0:1787906969.671157:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+52:11616:x1874755972064000:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906969.671185:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906969.671211:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae081 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef951 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.671313:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae088 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.671332:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae088 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.671345:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae088 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.671360:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae08f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.671367:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae08f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.671373:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae08f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.671756:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae096 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.671766:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.671773:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906969.671793:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787906969.672421:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae088 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672444:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae088 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672451:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae088 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672458:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906969.672462:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae088 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672470:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae088 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672484:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906969.672488:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906969.672493:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae088 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672499:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae088 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672514:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae08f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672521:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae08f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672539:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae08f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672544:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906969.672547:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae08f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672553:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae08f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672560:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906969.672563:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906969.672570:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae08f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672576:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae08f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672626:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae081 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef951 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672652:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef951 expref: 54 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.672660:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:2.0:1787906969.672662:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787906969.672664:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97400, rc 0) 00000100:00100000:2.0:1787906969.672759:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+54:11616:x1874755972064000:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1605us (1948us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787906969.672779:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 205 00000100:00100000:1.0:1787906969.678932:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.679312:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972064128 00000100:00100000:2.0:1787906969.679326:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972064128 00000100:00100000:2.0:1787906969.679404:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 206 00000100:00100000:2.0:1787906969.679417:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+54:11616:x1874755972064128:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:2.0:1787906969.679872:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.679893:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.679906:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.679938:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.679946:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.679956:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.679963:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906969.679968:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.679977:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.679992:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:2.0:1787906969.680025:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787906969.680031:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.680038:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906969.680270:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+54:11616:x1874755972064128:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 852us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906969.680280:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 206 00000100:00100000:0.0:1787906969.684411:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906969.684733:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972064384 00000100:00100000:3.0:1787906969.684747:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972064384 00000100:00100000:3.0:1787906969.684957:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:3.0:1787906969.684971:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+54:11616:x1874755972064384:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1787906969.685335:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+55:11616:x1874755972064384:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 358us (1005us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787906969.685345:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:0.0:1787906969.792193:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906969.792277:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972064640 00000100:00100000:3.0:1787906969.792289:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972064640 00000100:00100000:3.0:1787906969.792354:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 207 00000100:00100000:3.0:1787906969.792364:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+55:11626:x1874755972064640:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1787906969.792389:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906969.792392:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787906969.792437:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cae026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef935 expref: 55 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.792458:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:3.0:1787906969.792462:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787906969.792474:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae0ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef958 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.792566:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae0b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.792579:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.792588:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906969.792598:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787906969.793022:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae0ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef958 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.793039:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae0b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef958 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.793046:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:3.0:1787906969.793049:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787906969.793051:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030800, rc 0) 00000100:00100000:3.0:1787906969.793123:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+56:11626:x1874755972064640:12345-192.168.204.20@tcp:101:bash.0 Request processed in 759us (942us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787906969.793131:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 207 00000100:00100000:1.0:1787906969.800909:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906969.801173:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972064896 00000100:00100000:0.0:1787906969.801187:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972064896 00000100:00100000:0.0:1787906969.801263:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 208 00000100:00100000:0.0:1787906969.801277:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+56:11626:x1874755972064896:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:0.0:1787906969.801371:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787906969.801412:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae0b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef958 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.801450:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae096 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef951 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.801487:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:0.0:1787906969.801495:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787906969.801799:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae0c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.801847:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae0c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.801858:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae0c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787906969.801911:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1787906969.801933:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e0ba0f2 reply state 000000007a66e644 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae0c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906969.801942:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787906969.802059:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+57:11626:x1874755972064896:12345-192.168.204.20@tcp:36:bash.0 Request processed in 784us (1162us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787906969.802068:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 208 00000020:00080000:0.0:1787906969.802073:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787906969.807120:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae0c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.807144:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae0c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.807154:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae0c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.807161:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906969.807167:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae0c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.807175:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae0c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.807195:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:3.0:1787906969.807199:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906969.807222:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae0c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.807229:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae0c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906969.808682:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.809051:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972065024 00000100:00100000:2.0:1787906969.809072:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972065024 00000100:00100000:2.0:1787906969.809132:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 209 00000100:00100000:2.0:1787906969.809142:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+56:11626:x1874755972065024:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1787906969.809167:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906969.809185:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef95f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.809267:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae0ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.809281:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae0ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.809292:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae0ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906969.809321:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787906969.809326:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906969.809347:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae0ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.809392:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef95f expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.809409:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae0ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef95f expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.809418:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:2.0:1787906969.809421:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787906969.809424:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96200, rc 0) 00000100:00100000:2.0:1787906969.809496:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+57:11626:x1874755972065024:12345-192.168.204.20@tcp:101:bash.0 Request processed in 355us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906969.809503:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 209 00000100:00100000:1.0:1787906969.814363:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.814461:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972065280 00000100:00100000:2.0:1787906969.814472:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972065280 00000100:00100000:2.0:1787906969.814543:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:2.0:1787906969.814554:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+57:11626:x1874755972065280:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:2.0:1787906969.814986:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+58:11626:x1874755972065280:12345-192.168.204.20@tcp:35:bash.0 Request processed in 428us (626us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787906969.815005:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:1.0:1787906969.924074:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.924237:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972065408 00000100:00100000:2.0:1787906969.924247:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972065408 00000100:00100000:2.0:1787906969.924312:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 210 00000100:00100000:2.0:1787906969.924323:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+58:11632:x1874755972065408:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906969.924347:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906969.924369:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef966 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.924465:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae0dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.924480:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae0dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.924493:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae0dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906969.924560:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787906969.924564:0:10853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906969.924590:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae0dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.924616:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef966 expref: 60 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.924647:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae0dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef966 expref: 59 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.924655:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906969.924658:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787906969.924661:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97000, rc 0) 00000100:00100000:2.0:1787906969.924737:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+59:11632:x1874755972065408:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 416us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906969.924745:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 210 00000100:00100000:1.0:1787906969.929648:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906969.930294:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972065536 00000100:00100000:2.0:1787906969.930305:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972065536 00000100:00100000:2.0:1787906969.930424:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 211 00000100:00100000:2.0:1787906969.930436:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+59:11632:x1874755972065536:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906969.930456:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906969.930477:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae0e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef96d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930543:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae0ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930556:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae0ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930567:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae0ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930581:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae0f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930589:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930595:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930695:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae0f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930703:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930710:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906969.930758:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787906969.930762:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906969.930783:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930796:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930805:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae0ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930832:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae0ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930841:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae0ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930847:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906969.930853:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae0ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930860:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae0ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930875:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906969.930878:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906969.930884:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae0ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930891:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97400/0x72bb6cf063cae0ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930918:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930925:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae0f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930930:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930935:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906969.930939:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.930946:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae0f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.931040:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906969.931044:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906969.931047:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae0f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.931053:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae0f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.931086:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae0e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef96d expref: 61 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.931099:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae0f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef96d expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.931121:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:2.0:1787906969.931123:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787906969.931126:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96c00, rc 0) 00000100:00100000:2.0:1787906969.931257:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+60:11632:x1874755972065536:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 823us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906969.931265:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 211 00000100:00100000:1.0:1787906969.936886:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906969.936974:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906969.937125:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972065920 00000100:00100000:3.0:1787906969.937141:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972065920 00000100:00100000:3.0:1787906969.937235:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:3.0:1787906969.937250:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+60:2343:x1874755972065920:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787906969.937275:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906969.937312:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae0f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef96d expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.937336:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:3.0:1787906969.937341:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906969.937429:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+59:2343:x1874755972065920:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 182us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906969.937437:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:2.0:1787906969.940231:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972065792 00000100:00100000:2.0:1787906969.940250:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972065792 00000100:00100000:2.0:1787906969.940377:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 212 00000100:00100000:2.0:1787906969.940391:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+59:11632:x1874755972065792:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906969.940434:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906969.940456:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef974 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.940592:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.940609:0:10853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae0ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef95f expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.940618:0:10853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.940666:0:10853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae0ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef95f expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.940681:0:10853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae0ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef95f expref: 60 pid: 5830 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906969.940712:0:10853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000369280:192.168.204.20@tcp:104: 00000100:00100000:2.0:1787906969.940864:0:10853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507205900 going to sleep for 11 seconds 00000100:00100000:1.0:1787906969.945963:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906969.946317:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972066048 00000100:00100000:3.0:1787906969.946330:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972066048 00010000:00010000:3.0:1787906969.946377:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae0ce lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef95f expref: 61 pid: 5830 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906969.946435:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:3.0:1787906969.946447:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+61:2346:x1874755972066048:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787906969.946462:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906969.946471:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae0ce lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef95f expref: 61 pid: 5830 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.946493:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae0ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef95f expref: 61 pid: 5830 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.946517:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:3.0:1787906969.946523:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.946532:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.946539:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.946559:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906969.946611:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+61:2346:x1874755972066048:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 167us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906969.946618:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 77 00010000:00010000:2.0:1787906969.946786:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae0ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef95f expref: 60 pid: 5830 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906969.946803:0:10853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10853:1874756000369280:192.168.204.20@tcp:104: 00010000:00010000:2.0:1787906969.946845:0:10853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.946854:0:10853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.946861:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906969.946882:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787906969.947061:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97600/0x72bb6cf063cae0ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef974 expref: 61 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.947077:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef974 expref: 60 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906969.947084:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:2.0:1787906969.947087:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787906969.947090:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97800, rc 0) 00000100:00100000:2.0:1787906969.947121:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+60:11632:x1874755972065792:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 6733us (10322us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787906969.947137:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 212 00000100:00100000:1.0:1787906969.952689:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906969.952785:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972066304 00000100:00100000:3.0:1787906969.952796:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972066304 00000100:00100000:3.0:1787906969.953107:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:3.0:1787906969.953122:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+60:11632:x1874755972066304:12345-192.168.204.20@tcp:103:lfs.0 00010000:00010000:3.0:1787906969.953143:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906969.953175:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae065 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef94a expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.953199:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:3.0:1787906969.953205:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906969.953286:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+59:11632:x1874755972066304:12345-192.168.204.20@tcp:103:lfs.0 Request processed in 168us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906969.953294:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:1.0:1787906969.959146:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906969.959236:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972066432 00000100:00100000:0.0:1787906969.959251:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972066432 00000100:00100000:0.0:1787906969.959357:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 213 00000100:00100000:0.0:1787906969.959369:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+59:11632:x1874755972066432:12345-192.168.204.20@tcp:58:lfs.0 00010000:00010000:0.0:1787906969.959511:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae114 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.959530:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae114 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906969.959552:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae114 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787906969.960181:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787906969.960298:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+59:11632:x1874755972066432:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 930us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906969.960308:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 213 00000100:00100000:1.0:1787906969.963117:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906969.963212:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972066560 00000100:00100000:3.0:1787906969.963226:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972066560 00000100:00100000:3.0:1787906969.963293:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 214 00000100:00100000:3.0:1787906969.963303:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+59:11632:x1874755972066560:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906969.963325:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906969.963347:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae11b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef97b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.963411:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae114 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.963421:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae11b lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef97b expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.963440:0:5832:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae114 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.963453:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae11b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef97b expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.963467:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:3.0:1787906969.963470:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787906969.963474:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae11b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef97b expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906969.963483:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030200, rc 0) 00000100:00100000:3.0:1787906969.963551:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+60:11632:x1874755972066560:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 250us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906969.963559:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 214 00010000:00010000:2.0:1787906970.272482:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906970.635196:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906970.635262:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906970.635309:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906970.635350:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906970.635384:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906970.635492:0:11686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972066688 00000100:00100000:0.0:1787906970.635516:0:11686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972066688 00000100:00100000:3.0:1787906970.635564:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972067072 00000100:00100000:3.0:1787906970.635579:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972067072 00000100:00100000:0.0:1787906970.635600:0:11686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 308 00000100:00100000:0.0:1787906970.635615:0:11686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755972066688:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906970.635684:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972066944 00000100:00100000:3.0:1787906970.635690:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972066944 00000100:00100000:0.0:1787906970.635732:0:11686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755972066688:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 119us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906970.635741:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 105 00000100:00100000:0.0:1787906970.635763:0:11686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 308 00000100:00100000:3.0:1787906970.635765:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2345:x1874755972067072:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906970.635908:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2345:x1874755972067072:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 152us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906970.635917:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 106 00000100:00100000:3.0:1787906970.635928:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 105 00000100:00100000:0.0:1787906970.635935:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972066944:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:3.0:1787906970.635972:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787906970.636002:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972066944:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 72us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906970.636009:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972066816 00000100:00100000:0.0:1787906970.636011:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 106 00000100:00100000:3.0:1787906970.636018:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972066816 00000100:00100000:3.0:1787906970.636087:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972067200 00000100:00100000:3.0:1787906970.636092:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972067200 00000100:00100000:0.0:1787906970.636118:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 179 00000100:00100000:3.0:1787906970.636134:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 180 00000100:00100000:0.0:1787906970.636137:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52f365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+60:2345:x1874755972066816:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906970.636152:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755972067200:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906970.636186:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52f365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+60:2345:x1874755972066816:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 55us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906970.636196:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 179 00000100:00100000:3.0:1787906970.636201:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755972067200:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 53us (814us total) trans 0 rc 0/0 00000100:00080000:0.0:1787906970.636689:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906970.641110:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 180 00000040:00080000:2.0:1787906970.785060:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787906970.785074:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787906970.785275:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787906970.785284:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787906970.785470:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874756000369408:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787906970.786372:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5072059c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787906970.807194:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874756000369408:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787906970.829252:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906970.829465:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972067328 00000100:00100000:0.0:1787906970.829482:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972067328 00000100:00100000:0.0:1787906970.829677:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00100000:0.0:1787906970.829693:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+60:11633:x1874755972067328:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787906970.829756:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787906970.830111:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+60:11633:x1874755972067328:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 420us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906970.830122:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00100000:1.0:1787906970.836660:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906970.836925:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972067456 00000100:00100000:2.0:1787906970.836940:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972067456 00000100:00100000:2.0:1787906970.837105:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 216 00000100:00100000:2.0:1787906970.837120:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa40203e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+60:11633:x1874755972067456:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787906970.837226:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae122 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.837248:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae122 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.837265:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae122 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840633:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae129 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840657:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae129 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840690:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae129 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840727:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae130 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840735:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840742:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906970.840805:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787906970.840828:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787906970.840844:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840857:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae122 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840864:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae122 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840871:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae122 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840876:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906970.840881:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae122 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840888:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae122 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840909:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa518965b00) 00010000:00010000:2.0:1787906970.840911:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906970.840916:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae122 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840922:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae122 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840942:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae129 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840949:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae129 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840960:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae129 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.840965:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906970.840968:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae129 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.841180:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae129 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.841192:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8aa5069aa400) 00010000:00010000:2.0:1787906970.841195:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906970.841198:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae129 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.841205:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae129 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.841244:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.841251:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae130 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.841257:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.841261:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906970.841264:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.841270:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae130 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.841277:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:2.0:1787906970.841279:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906970.841282:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae130 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.841287:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae130 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906970.841417:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa40203e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+60:11633:x1874755972067456:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 4295us (4765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906970.841427:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 216 00000100:00100000:2.0:1787906970.845275:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906970.845595:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972067712 00000100:00100000:1.0:1787906970.845606:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972067712 00000100:00100000:1.0:1787906970.845760:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 217 00000100:00100000:1.0:1787906970.845770:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+60:11633:x1874755972067712:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787906970.845800:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906970.845868:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cae137 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef982 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.845996:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae13e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.846012:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae13e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.846024:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae13e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787906970.846036:0:10853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787906970.846138:0:10853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae13e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.846159:0:10853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae13e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.846166:0:10853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae13e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.846173:0:10853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906970.846178:0:10853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae13e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.846185:0:10853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae13e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.846198:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:1.0:1787906970.846201:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787906970.846206:0:10853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae13e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.846212:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae13e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.846350:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cae137 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef982 expref: 62 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.846361:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa518965b00) 00010000:00010000:1.0:1787906970.846364:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787906970.846367:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211a00/0x72bb6cf063cae137 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef982 expref: 62 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.846378:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211a00, rc 0) 00000100:00100000:1.0:1787906970.846503:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+61:11633:x1874755972067712:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 724us (1228us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1787906970.846512:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 217 00000100:00100000:1.0:1787906970.851348:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906970.851518:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972067840 00000100:00100000:3.0:1787906970.851534:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972067840 00000100:00100000:3.0:1787906970.851700:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 218 00000100:00100000:3.0:1787906970.851717:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+61:11633:x1874755972067840:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787906970.851778:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787906970.852178:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+61:11633:x1874755972067840:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 463us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906970.852188:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 218 00000100:00100000:2.0:1787906970.860724:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906970.865429:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972068096 00000100:00100000:0.0:1787906970.865463:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972068096 00000100:00100000:0.0:1787906970.865760:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 219 00000100:00100000:0.0:1787906970.865777:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+61:11633:x1874755972068096:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787906970.865809:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906970.865832:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787906970.865876:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae0dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef966 expref: 61 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.865907:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:0.0:1787906970.865913:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787906970.865937:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae14c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef989 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787906970.866594:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1787906970.867197:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cae153 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.867215:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cae153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.867246:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cae153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.867330:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae14c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef989 expref: 63 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.867356:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cae153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef989 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.867367:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa510860700) 00010000:00010000:0.0:1787906970.867371:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906970.867375:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8e200, rc 0) 00000100:00100000:0.0:1787906970.867668:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+62:11633:x1874755972068096:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1832us (6903us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787906970.867681:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 219 00000100:00100000:1.0:1787906970.883323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906970.883476:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972068352 00000100:00100000:2.0:1787906970.883723:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972068352 00000100:00100000:2.0:1787906970.883846:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 220 00000100:00100000:2.0:1787906970.883860:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+62:11633:x1874755972068352:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787906970.883965:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906970.884024:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cae153 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef989 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884057:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa510860700) 00010000:00010000:2.0:1787906970.884076:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787906970.884110:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae161 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884126:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae161 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884137:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae161 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884152:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae168 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6ea07e05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884159:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae168 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ea07e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884166:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae168 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ea07e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884267:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae161 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884276:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae161 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884292:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae161 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884298:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906970.884304:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae161 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884313:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae161 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884323:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:2.0:1787906970.884326:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906970.884329:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae161 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884336:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae161 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884348:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae168 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ea07e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884354:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae168 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ea07e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884359:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae168 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ea07e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884365:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906970.884368:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae168 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ea07e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.884385:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae168 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ea07e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.885117:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6ea07e05 (ffff8aa5069aa400) 00010000:00010000:2.0:1787906970.885124:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787906970.885129:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae168 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6ea07e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906970.885137:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae168 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6ea07e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906970.885262:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+61:11633:x1874755972068352:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1402us (1957us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787906970.885272:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 220 00000100:00100000:2.0:1787906970.890138:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906970.893693:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972068480 00000100:00100000:1.0:1787906970.893720:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972068480 00000100:00100000:1.0:1787906970.893860:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 221 00000100:00100000:1.0:1787906970.893874:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+61:11633:x1874755972068480:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787906970.893908:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787906970.893947:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae16f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef990 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.894006:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cae176 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.894024:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cae176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.894040:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cae176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.894192:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae16f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef990 expref: 63 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.894215:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cae176 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef990 expref: 62 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906970.894226:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa518965f00) 00010000:00010000:1.0:1787906970.894238:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787906970.894243:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211000, rc 0) 00000100:00100000:1.0:1787906970.894348:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+62:11633:x1874755972068480:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 476us (4227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906970.894357:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 221 00000100:00100000:1.0:1787906970.904577:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906970.904744:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972068736 00000100:00100000:3.0:1787906970.904759:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972068736 00000100:00100000:3.0:1787906970.904892:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 222 00000100:00100000:3.0:1787906970.904905:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+62:11633:x1874755972068736:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787906970.905036:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae17d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906970.905058:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae17d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906970.905073:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae17d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787906970.905424:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1787906970.905436:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409177623104ns, next at 410177620189ns, rc = 0 00000004:00010000:3.0:1787906970.905788:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000454a3751 reply state 00000000ee36e119 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae17d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906970.905800:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787906970.906007:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+64:11633:x1874755972068736:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1102us (1443us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1787906970.906017:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 222 00010000:00010000:0.0:1787906970.910216:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae17d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.910244:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae17d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.910253:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae17d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.910261:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906970.910266:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae17d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.910275:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae17d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.910317:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa518965f00) 00010000:00010000:0.0:1787906970.910320:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787906970.910338:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae17d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.910345:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae17d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906970.913318:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906970.913411:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972068864 00000100:00100000:0.0:1787906970.913425:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972068864 00000100:00100000:0.0:1787906970.913501:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 223 00000100:00100000:0.0:1787906970.913513:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+63:11633:x1874755972068864:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787906970.913554:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906970.913584:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae184 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef997 expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.913678:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae184 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef997 expref: 64 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.913695:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae184 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef997 expref: 64 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.913719:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa518965f00) 00010000:00010000:0.0:1787906970.913723:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787906970.913727:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8e600, rc 0) 00000100:00100000:0.0:1787906970.913806:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+64:11633:x1874755972068864:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 295us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906970.913862:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 223 00000100:00100000:2.0:1787906970.918219:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906970.918335:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972068992 00000100:00100000:3.0:1787906970.918351:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972068992 00000100:00100000:3.0:1787906970.918785:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:3.0:1787906970.918801:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2346:x1874755972068992:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787906970.919401:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+10:2346:x1874755972068992:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 576us (1176us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787906970.919411:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:2.0:1787906970.923353:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906970.923465:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972069248 00000100:00100000:0.0:1787906970.923480:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972069248 00000100:00100000:0.0:1787906970.923571:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:0.0:1787906970.923583:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+64:11633:x1874755972069248:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787906970.924012:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+65:11633:x1874755972069248:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 429us (681us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787906970.924024:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:1.0:1787906970.928274:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906970.928409:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972069504 00000100:00100000:2.0:1787906970.928428:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972069504 00000100:00100000:2.0:1787906970.928515:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 224 00000100:00100000:2.0:1787906970.928529:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+65:11633:x1874755972069504:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787906970.928707:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+65:11633:x1874755972069504:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 181us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906970.928716:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 224 00000100:00100000:2.0:1787906970.933383:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906970.934012:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972069632 00000100:00100000:0.0:1787906970.934033:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972069632 00000100:00100000:0.0:1787906970.934126:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 225 00000100:00100000:0.0:1787906970.934140:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+65:11633:x1874755972069632:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787906970.934174:0:10853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906970.934211:0:10853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cae18b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef99e expref: -99 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.934365:0:10853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae192 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.934383:0:10853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.934411:0:10853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906970.934762:0:10853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787906970.935085:0:10853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.935140:0:10853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e200/0x72bb6cf063cae18b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef99e expref: 67 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.935162:0:10853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef99e expref: 66 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906970.935171:0:10853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa518965f00) 00010000:00010000:0.0:1787906970.935174:0:10853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787906970.935179:0:10853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f800, rc 0) 00000100:00100000:0.0:1787906970.935307:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+66:11633:x1874755972069632:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1170us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906970.935316:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 225 00000100:00100000:1.0:1787906970.944013:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906970.944155:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972069760 00000100:00100000:3.0:1787906970.944171:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972069760 00000100:00100000:3.0:1787906970.944256:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:3.0:1787906970.944267:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+10:2346:x1874755972069760:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787906970.944293:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906970.944324:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cae199 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef9a5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787906970.944362:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a914b9a, blocks: 0x1 00010000:00010000:3.0:1787906970.944386:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787906970.944392:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906970.944403:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cae199 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9a5 expref: 11 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906970.944424:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cae199 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9a5 expref: 11 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906970.944440:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031a00, rc 0) 00000100:00100000:3.0:1787906970.944897:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+11:2346:x1874755972069760:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 629us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906970.944906:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:2.0:1787906970.948766:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906970.949263:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972070016 00000100:00100000:3.0:1787906970.949305:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972070016 00000100:00100000:3.0:1787906970.949398:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 226 00000100:00100000:3.0:1787906970.949412:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+66:11633:x1874755972070016:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787906970.949592:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+66:11633:x1874755972070016:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 182us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906970.949602:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 226 00000100:00100000:2.0:1787906970.952949:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906970.953141:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972070144 00000100:00100000:3.0:1787906970.953156:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972070144 00000100:00100000:3.0:1787906970.953232:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:3.0:1787906970.953245:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+11:11633:x1874755972070144:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787906970.953271:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906970.953297:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cae1a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef9ac expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906970.953341:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cae199 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9a5 expref: 12 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906970.953352:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906970.953357:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906970.953364:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cae1a0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ac expref: 12 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906970.953410:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cae199 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9a5 expref: 12 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906970.953426:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cae199 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9a5 expref: 12 pid: 6673 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906970.953454:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508201500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1874756000369536:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906970.953573:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3480 going to sleep for 11 seconds 00000100:00100000:3.0:1787906970.959699:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508201500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1874756000369536:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787906970.959759:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cae1a0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ac expref: 12 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906970.959790:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030800, rc 0) 00000100:00100000:3.0:1787906970.960085:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+12:11633:x1874755972070144:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 6840us (7152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906970.960098:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:2.0:1787906970.963961:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906970.964082:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972070272 00000100:00100000:3.0:1787906970.964096:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972070272 00010000:00010000:3.0:1787906970.964157:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cae199 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9a5 expref: 12 pid: 6673 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906970.964264:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:3.0:1787906970.964278:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+12:2346:x1874755972070272:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787906970.964299:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906970.964329:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cae199 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9a5 expref: 12 pid: 6673 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906970.964346:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cae199 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9a5 expref: 12 pid: 6673 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906970.964414:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb8025be/0x72bb6cf063cae199 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9a5 expref: 12 pid: 6673 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906970.964435:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906970.964441:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906970.964460:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cae1a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ac expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906970.964473:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cae1a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ac expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906970.964533:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cae1a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ac expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906970.964551:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508201500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5817:1874756000369664:192.168.204.20@tcp:105: 00000100:00100000:3.0:1787906970.964729:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3480 going to sleep for 11 seconds 00000100:00100000:2.0:1787906970.969022:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906970.969192:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508201500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5817:1874756000369664:192.168.204.20@tcp:105: 00010000:00010000:3.0:1787906970.969227:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906970.969308:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+11:2346:x1874755972070272:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 5031us (5365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906970.969322:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:1.0:1787906970.970117:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972070400 00000100:00100000:1.0:1787906970.970131:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972070400 00002000:00100000:1.0:1787906970.970197:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8aa535e8a680 x1874755972070400/t0(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:541/0 lens 504/0 e 0 to 0 dl 1787906981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787906970.970211:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa535e8a680 with x1874755972070400 ext(0->12) 00002000:00010000:1.0:1787906970.970217:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa535e8a680 00000100:00100000:1.0:1787906970.970252:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:1.0:1787906970.970263:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+11:2345:x1874755972070400:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787906970.971323:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+13:2345:x1874755972070400:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 Request processed in 1045us (2302us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787906970.971340:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00002000:00100000:1.0:1787906970.971356:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8aa535e8a680 x1874755972070400/t4294967320(0) o4->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:541/0 lens 504/448 e 0 to 0 dl 1787906981 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787906970.971368:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa535e8a680 with x1874755972070400 ext(0->12) 00002000:00010000:1.0:1787906970.971374:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa535e8a680 00000100:00100000:2.0:1787906970.975306:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906970.975432:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972070528 00000100:00100000:0.0:1787906970.975457:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972070528 00000100:00100000:0.0:1787906970.975554:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 227 00000100:00100000:0.0:1787906970.975567:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+66:11633:x1874755972070528:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787906971.040708:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:3.0:1787906971.040754:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa506904d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787906971.040762:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa5102aca00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa506904240 00000020:00080000:3.0:1787906971.040787:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa5102ac000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa508a5a400 00000020:00080000:2.0:1787906971.040837:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787906971.040915:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa5069040c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787906971.040919:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa507c07800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa506904e40 00000020:00080000:3.0:1787906971.040923:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa507c07a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa52f3f8c00 00000020:00080000:2.0:1787906971.040955:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1787906971.041245:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:3.0:1787906971.041336:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1787906971.041420:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:1.0:1787906971.041705:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+33:11633:x1874755972070528:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 66129us (66409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906971.041731:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 227 00000100:00100000:2.0:1787906971.042476:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787906971.042509:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000369792:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787906971.043331:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906971.043406:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000369920:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787906971.043456:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906971.044925:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000369792 00000100:00100000:0.0:1787906971.044944:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000369792 00000100:00100000:0.0:1787906971.045076:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000369920 00000100:00100000:0.0:1787906971.045080:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000369920 00000100:00100000:0.0:1787906971.045117:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787906971.045129:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1874756000369792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787906971.045176:0:8459:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1787906971.045215:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae1a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.045267:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cadf69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef90b expref: 12 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.045278:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1787906971.045283:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787906971.045288:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae1a7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.045335:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cadf69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef90b expref: 12 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.045353:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cadf69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef90b expref: 12 pid: 6673 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906971.045373:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507d3aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8459:1874756000370048:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906971.045702:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52f290900 going to sleep for 11 seconds 00000100:00080000:1.0:1787906971.045800:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787906971.045902:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787906971.045915:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1874756000369920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787906971.046156:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787906971.046160:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787906970 00002000:00010000:2.0:1787906971.046163:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787906971.046165:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787906970 -> 1787906970 00002000:00010000:2.0:1787906971.046167:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787906971.046259:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3303:x1874756000369920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 348us (2815us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787906971.046267:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1787906971.046431:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa535e8b800/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787906971.046439:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000369920:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1787906971.047242:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:3.0:1787906971.048989:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5347a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000370176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787906971.049112:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906971.049203:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000370176 00000100:00100000:3.0:1787906971.049212:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000370176 00000100:00100000:3.0:1787906971.049276:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787906971.049289:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874756000370176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787906971.049320:0:6674:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1787906971.049368:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a914b99, atime: 0x6a914b99, ctime: 0x6a914b99, blocks: 0x1 00010000:00010000:3.0:1787906971.049379:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae1ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.049401:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787906971.049407:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906971.049415:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae1ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.049436:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae1ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.049720:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae1ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.049728:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae1ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.049755:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1787906971.050250:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787906971.054417:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1874756000370176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5114us (5290us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787906971.054440:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1787906971.054519:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787906971.054530:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae1ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.054546:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787906971.054551:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae1ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.054563:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae1ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.054593:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae1ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.054602:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae1ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.054940:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906971.054943:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906971.054945:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906971.055210:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906971.055370:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906971.056079:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507d3aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8459:1874756000370048:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906971.056117:0:8459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae1a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906971.056325:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972070656 00000100:00100000:3.0:1787906971.056337:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972070656 00000100:00100000:3.0:1787906971.056738:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:3.0:1787906971.056753:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+13:2344:x1874755972070656:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787906971.056894:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972070784 00000100:00100000:0.0:1787906971.056914:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972070784 00010000:00010000:0.0:1787906971.056941:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cadf69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef90b expref: 14 pid: 6673 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906971.056984:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:0.0:1787906971.056993:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5030aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+14:2345:x1874755972070784:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906971.057006:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906971.057013:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cadf69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef90b expref: 14 pid: 6673 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.057029:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cadf69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef90b expref: 14 pid: 6673 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.057059:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cadf69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef90b expref: 14 pid: 6673 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.057079:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787906971.057085:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787906971.057091:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae1a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.057101:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae1a7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.057129:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906971.057199:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5030aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+13:2345:x1874755972070784:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 206us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906971.057215:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00010000:00010000:0.0:1787906971.057281:0:8459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae1a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.057290:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae1a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.057301:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae1a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.057310:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae1a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.057328:0:8459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787906971.059911:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787906971.059930:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae1a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.059968:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8ec00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787906971.059985:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae1a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.059999:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae1a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.060031:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae1a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.060038:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae1a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.060071:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906971.060073:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906971.060075:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787906971.060432:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa5347a7480/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787906971.060683:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5347a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000370176:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787906971.061380:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3301:x1874756000369792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16245us (18046us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787906971.061393:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:0.0:1787906971.061521:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa535e8bb80/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787906971.061527:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000369792:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1787906971.097304:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1787906971.097337:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1787906971.097347:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1787906971.097637:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2344:x1874755972070656:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 40877us (42421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906971.097653:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:2.0:1787906971.100954:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906971.101105:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972071040 00000100:00100000:3.0:1787906971.101118:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972071040 00000100:00100000:3.0:1787906971.101192:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 228 00000100:00100000:3.0:1787906971.101206:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+20:11633:x1874755972071040:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787906971.101281:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906971.101319:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae192 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef99e expref: 20 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.101346:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa518965f00) 00010000:00010000:3.0:1787906971.101352:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787906971.101393:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae1b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.101585:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae1b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.101630:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae1b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787906971.102017:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000762a38fa reply state 00000000969923ff transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae1b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906971.102028:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787906971.102167:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+21:11633:x1874755972071040:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 960us (1224us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787906971.102175:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 228 00010000:00010000:3.0:1787906971.106988:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae1b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.107013:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae1b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.107021:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae1b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.107028:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906971.107034:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae1b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.107043:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae1b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.107069:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa518965f00) 00010000:00010000:3.0:1787906971.107072:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906971.107079:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae1b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.107108:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae1b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906971.109019:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906971.109131:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972071168 00000100:00100000:3.0:1787906971.109145:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972071168 00000100:00100000:3.0:1787906971.109219:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:3.0:1787906971.109232:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972071168:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787906971.109548:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787906971.109553:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787906970 -> 1787906969 00002000:00010000:3.0:1787906971.109556:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787906969 00002000:00010000:3.0:1787906971.109558:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787906970 -> 1787906969 00002000:00010000:3.0:1787906971.109561:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787906971.109645:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2345:x1874755972071168:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 414us (642us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787906971.109653:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:2.0:1787906971.116521:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906971.116626:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972071424 00000100:00100000:1.0:1787906971.116699:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972071424 00000100:00100000:1.0:1787906971.116881:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 229 00000100:00100000:1.0:1787906971.116895:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+20:11633:x1874755972071424:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787906971.116999:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.117022:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cae176 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef990 expref: 20 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.117033:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.117083:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cae176 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef990 expref: 20 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.117100:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cae176 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef990 expref: 20 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906971.117147:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5347a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874756000370304:192.168.204.20@tcp:104: 00000100:00100000:1.0:1787906971.117247:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa501668000 going to sleep for 11 seconds 00000100:00100000:0.0:1787906971.130274:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5347a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874756000370304:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906971.130321:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906971.131070:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906971.131211:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972071552 00000100:00100000:1.0:1787906971.131222:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972071552 00010000:00010000:1.0:1787906971.131277:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cae176 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef990 expref: 21 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906971.131323:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:1.0:1787906971.131334:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b034000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+21:2345:x1874755972071552:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787906971.131355:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787906971.131364:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cae176 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef990 expref: 21 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.131379:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cae176 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef990 expref: 21 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.131409:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211000/0x72bb6cf063cae176 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef990 expref: 21 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.131429:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa518965f00) 00010000:00010000:1.0:1787906971.131435:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.131447:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.131480:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.131530:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787906971.131602:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b034000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+20:2345:x1874755972071552:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 269us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906971.131622:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00010000:00010000:0.0:1787906971.135442:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.135510:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.135556:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.135563:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.135571:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.135578:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211e00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787906971.135584:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.135593:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.135752:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa518965f00) 00010000:00010000:0.0:1787906971.135757:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787906971.135762:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.135769:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211e00/0x72bb6cf063cae1bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906971.136153:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+19:11633:x1874755972071424:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 Request processed in 19253us (19639us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787906971.136167:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 229 00000100:00100000:1.0:1787906971.140343:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906971.140439:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972071680 00000100:00100000:0.0:1787906971.140453:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972071680 00000100:00100000:0.0:1787906971.140533:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:0.0:1787906971.140546:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972071680:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787906971.140609:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae1c3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.140638:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cae1a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ac expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.140649:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787906971.140654:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787906971.140659:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae1c3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.140708:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cae1a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ac expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.140726:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cae1a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ac expref: 8 pid: 6675 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906971.140745:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507d3aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8459:1874756000370432:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787906971.141241:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa518610300 going to sleep for 11 seconds 00000100:00100000:0.0:1787906971.148329:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507d3aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8459:1874756000370432:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906971.148381:0:8459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae1c3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906971.151553:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906971.151883:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972071808 00000100:00100000:0.0:1787906971.151900:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972071808 00010000:00010000:0.0:1787906971.151996:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cae1a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ac expref: 9 pid: 6675 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906971.152055:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:0.0:1787906971.152068:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+9:2346:x1874755972071808:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906971.152094:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906971.152131:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cae1a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ac expref: 9 pid: 6675 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.152148:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cae1a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ac expref: 9 pid: 6675 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.152182:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e5b0d87/0x72bb6cf063cae1a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ac expref: 9 pid: 6675 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.152204:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787906971.152209:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787906971.152216:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae1c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.152231:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae1c3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.152307:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906971.152399:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2346:x1874755972071808:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 332us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906971.152408:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00010000:00010000:1.0:1787906971.152929:0:8459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae1c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.152954:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae1c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.153004:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae1c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.153013:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae1c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.153022:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae1c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.153030:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f800 already unused, calling callback (ffffffffc1439230) 00010000:00010000:1.0:1787906971.153035:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae1c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.153059:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae1c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.153076:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae1c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.153085:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae1c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906971.153167:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972071680:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 12622us (12842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906971.153177:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:1.0:1787906971.166684:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906971.172346:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972072064 00000100:00100000:3.0:1787906971.172370:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972072064 00000100:00100000:2.0:1787906971.172601:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 230 00000100:00100000:2.0:1787906971.172617:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+19:11633:x1874755972072064:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787906971.172745:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae1ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.172807:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae1ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.172861:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae1ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.173417:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.173439:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae184 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef997 expref: 20 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.173448:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.173507:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae184 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef997 expref: 20 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.173526:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae184 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef997 expref: 20 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906971.173544:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b037480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000370560:192.168.204.20@tcp:104: 00000100:00100000:2.0:1787906971.173669:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5072059c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787906971.181263:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906971.181442:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b037480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000370560:192.168.204.20@tcp:104: 00010000:00010000:1.0:1787906971.181494:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906971.182122:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972072192 00000100:00100000:3.0:1787906971.182135:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972072192 00010000:00010000:3.0:1787906971.182195:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae184 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef997 expref: 21 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906971.182248:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:3.0:1787906971.182259:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b035c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+21:2345:x1874755972072192:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787906971.182279:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906971.182288:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae184 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef997 expref: 21 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.182322:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae184 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef997 expref: 21 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.182351:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae184 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef997 expref: 21 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.182372:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa518965f00) 00010000:00010000:3.0:1787906971.182378:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.182389:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.182410:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.182442:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906971.182528:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b035c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+20:2345:x1874755972072192:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 270us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906971.182536:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 82 00010000:00010000:2.0:1787906971.182956:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.182966:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787906971.183250:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787906971.183446:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787906971.183508:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787906971.183604:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b037480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874756000370688:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787906971.183672:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906971.183701:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507205780 going to sleep for 11 seconds 00000100:00100000:3.0:1787906971.183890:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000370688 00000100:00100000:3.0:1787906971.183900:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000370688 00000100:00100000:3.0:1787906971.183977:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787906971.183988:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52efe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1874756000370688:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787906971.184074:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52efe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1874756000370688:12345-0@lo:1000:mdt00_002.0 Request processed in 88us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906971.184082:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787906971.184689:0:5832:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1787906971.184697:0:5832:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1787906971.184723:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa535e8b800, transno 4294967321 00000100:00100000:2.0:1787906971.184982:0:5832:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8aa535e8bb80 x1874756000369792/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787906987 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787906971.184998:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b037480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874756000370688:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787906971.185779:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787906971.186145:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b037480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874756000370816:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787906971.186244:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906971.186694:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000370816 00000100:00100000:1.0:1787906971.186704:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000370816 00000100:00100000:1.0:1787906971.186776:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787906971.186788:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1874756000370816:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787906971.187270:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507205c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787906971.188751:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5832:x1874756000370816:12345-0@lo:1000:mdt00_002.0 Request processed in 1955us (2497us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787906971.188768:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787906971.189139:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b037480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874756000370816:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787906971.189204:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189216:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189224:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189230:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906971.189249:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189259:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189279:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa518965f00) 00010000:00010000:2.0:1787906971.189282:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787906971.189288:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189295:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189336:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae114 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189343:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae114 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189349:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae114 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189355:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906971.189359:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae114 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189365:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae114 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189373:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:2.0:1787906971.189376:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787906971.189390:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae11b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef97b expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189606:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae11b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef97b expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189617:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae11b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef97b expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.189662:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae11b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef97b expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906971.189679:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d61180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000370944:192.168.204.20@tcp:105: 00000100:00100000:2.0:1787906971.189925:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507205c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787906971.194907:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906971.195060:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972072320 00000100:00100000:0.0:1787906971.195074:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972072320 00000100:00100000:0.0:1787906971.195146:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:0.0:1787906971.195159:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+24:11632:x1874755972072320:12345-192.168.204.20@tcp:49:lfs.0 00000100:00100000:0.0:1787906971.195347:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+24:11632:x1874755972072320:12345-192.168.204.20@tcp:49:lfs.0 Request processed in 189us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906971.195356:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:1.0:1787906971.195540:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d61180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874756000370944:192.168.204.20@tcp:105: 00010000:00010000:1.0:1787906971.195594:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae114 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195617:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f600/0x72bb6cf063cae114 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195661:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae1d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195679:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae1d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195693:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae1d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195703:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae1d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195709:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae1d8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195715:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae1d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195722:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906971.195727:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae1d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195735:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae1d8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195747:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:1.0:1787906971.195750:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787906971.195761:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae1d8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195767:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210600/0x72bb6cf063cae1d8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195777:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae1ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195783:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae1ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195789:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae1ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195795:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787906971.195798:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae1ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.195803:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae1ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.196052:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:1.0:1787906971.196056:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787906971.196060:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae1ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.196067:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96200/0x72bb6cf063cae1ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787906971.196334:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+23:11633:x1874755972072064:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 23718us (29664us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1787906971.196344:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 230 00000020:00080000:1.0:1787906971.196357:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787906971.196598:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787906971.196615:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787906971.197444:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787906971.197458:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787906971.204742:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906971.205086:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906971.205179:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972072832 00000100:00100000:1.0:1787906971.205192:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972072832 00000100:00100000:1.0:1787906971.205272:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 231 00000100:00100000:1.0:1787906971.205285:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+23:11632:x1874755972072832:12345-192.168.204.20@tcp:58:lfs.0 00000040:00080000:1.0:1787906971.206644:0:10853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787906971.207241:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+23:11632:x1874755972072832:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 1522us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906971.207259:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 231 00000100:00100000:2.0:1787906971.207732:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972072576 00000100:00100000:2.0:1787906971.207745:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972072576 00000100:00100000:2.0:1787906971.207907:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:2.0:1787906971.207920:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52939a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+23:11633:x1874755972072576:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787906971.209345:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787906971.209463:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787906971.209549:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.209570:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.209585:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.209615:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.209623:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.209631:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906971.209656:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787906971.209794:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52939a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+25:11633:x1874755972072576:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 1871us (5062us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787906971.209804:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000020:00080000:2.0:1787906971.211119:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787906971.215585:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787906971.215618:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.215634:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:1.0:1787906971.215640:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.215654:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.215683:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa5069aa100) 00010000:00010000:1.0:1787906971.215687:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787906971.215694:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1df lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.215700:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97a00/0x72bb6cf063cae1df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906971.215737:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906971.215740:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906971.215742:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906971.250176:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906971.250283:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972072960 00000100:00100000:3.0:1787906971.250297:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972072960 00000100:00100000:3.0:1787906971.250380:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 232 00000100:00100000:3.0:1787906971.250403:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+25:11635:x1874755972072960:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787906971.250445:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906971.250477:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae1e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef9b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.250577:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cae1ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.250598:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cae1ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.250624:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cae1ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.250642:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cae1f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.250650:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cae1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.250658:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cae1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.251145:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae1fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.251173:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef974 expref: 26 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.251183:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae1fb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.251233:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef974 expref: 26 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.251251:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef974 expref: 26 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787906971.251269:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508201180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874756000371072:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787906971.251380:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3480 going to sleep for 11 seconds 00000100:00100000:0.0:1787906971.255949:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508201180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874756000371072:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787906971.256014:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae1fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906971.259900:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906971.260025:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972073216 00000100:00100000:3.0:1787906971.260041:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972073216 00000100:00100000:3.0:1787906971.260131:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:3.0:1787906971.260145:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+27:5586:x1874755972073216:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787906971.260464:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+28:5586:x1874755972073216:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 320us (582us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1787906971.260474:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:3.0:1787906971.263210:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906971.263342:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972073344 00000100:00100000:0.0:1787906971.263358:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972073344 00010000:00010000:0.0:1787906971.263431:0:8506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef974 expref: 28 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787906971.263496:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:0.0:1787906971.263509:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508200700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+28:2345:x1874755972073344:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906971.263528:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906971.263549:0:8506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef974 expref: 28 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.263566:0:8506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef974 expref: 28 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.263593:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97800/0x72bb6cf063cae106 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef974 expref: 28 pid: 10853 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.263625:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:0.0:1787906971.263631:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae1fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.263642:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae1fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.263650:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae1fb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906971.263690:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787906971.263913:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae1fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.263923:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae1fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787906971.264011:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787906971.264018:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787906971.264048:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae1fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264065:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae1fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264078:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cae1ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264086:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cae1ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264095:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cae1ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264103:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906971.264109:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cae1ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264118:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cae1ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264130:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:3.0:1787906971.264133:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906971.264137:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cae1ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264143:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030a00/0x72bb6cf063cae1ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264169:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cae1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264175:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cae1f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264181:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cae1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264186:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787906971.264189:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cae1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264195:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cae1f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264203:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa5069ca000) 00010000:00010000:3.0:1787906971.264205:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787906971.264208:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cae1f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264213:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030000/0x72bb6cf063cae1f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264254:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031a00/0x72bb6cf063cae1e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9b3 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264268:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae1fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9b3 expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906971.264285:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:3.0:1787906971.264287:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787906971.264290:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030800, rc 0) 00000100:00100000:0.0:1787906971.264380:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508200700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+27:2345:x1874755972073344:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 872us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906971.264391:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:3.0:1787906971.265807:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+26:11635:x1874755972072960:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 15399us (15632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906971.265843:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 232 00010000:00010000:3.0:1787906971.296152:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906971.296852:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000371200:0@lo:400:kworker.0 00000100:00100000:0.0:1787906971.296991:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906971.297063:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787906971.297070:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508201880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000371328:0@lo:400:kworker.0 00000100:00100000:0.0:1787906971.297103:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906971.297150:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000371328 00000100:00100000:0.0:1787906971.297189:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000371328 00000100:00100000:0.0:1787906971.297257:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787906971.297267:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000371328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906971.297336:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000371328:12345-0@lo:400:kworker.0 Request processed in 70us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906971.297344:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787906971.297401:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508201880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000371328:0@lo:400:kworker.0 00000100:00100000:3.0:1787906971.297503:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000371200 00000100:00100000:3.0:1787906971.297508:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000371200 00000100:00100000:3.0:1787906971.297552:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787906971.297560:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa50726b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3301:x1874756000371200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906971.297611:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa50726b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3301:x1874756000371200:12345-0@lo:400:kworker.0 Request processed in 43us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906971.297618:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787906971.297886:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000371456:0@lo:400:kworker.0 00000100:00100000:1.0:1787906971.297926:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906971.297952:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787906971.297959:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000371584:0@lo:400:kworker.0 00000100:00100000:1.0:1787906971.297996:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906971.298025:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000371456 00000100:00100000:1.0:1787906971.298030:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000371456 00000100:00100000:1.0:1787906971.298068:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000371584 00000100:00100000:1.0:1787906971.298072:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000371584 00000100:00100000:1.0:1787906971.298089:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787906971.298095:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000371456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906971.298140:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000371456:12345-0@lo:400:kworker.0 Request processed in 44us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906971.298147:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787906971.298160:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787906971.298165:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000371584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906971.298193:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000371584:12345-0@lo:400:kworker.0 Request processed in 28us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906971.298199:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:1.0:1787906971.298217:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906971.298240:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000371584:0@lo:400:kworker.0 00000100:00100000:1.0:1787906971.298249:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000371456:0@lo:400:kworker.0 00000100:00100000:0.0:1787906971.298344:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000371200:0@lo:400:kworker.0 00000001:00080000:0.0:1787906971.417430:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1787906971.417459:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1787906971.417468:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1787906971.808687:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787906971.813238:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5347a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000371712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787906971.813363:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906971.813468:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000371712 00000100:00100000:3.0:1787906971.814418:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000371712 00000100:00100000:3.0:1787906971.814521:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787906971.814535:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508203100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874756000371712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787906971.814584:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787906971.814689:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508203100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874756000371712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906971.814698:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787906971.814803:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5347a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000371712:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787906972.258298:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787906972.258318:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787906972.258377:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787906972.258387:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787906972.258642:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508201c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874756000371840:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787906972.258794:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa506904c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787906972.277280:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906972.277366:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972073472 00000100:00100000:3.0:1787906972.277383:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972073472 00000100:00100000:3.0:1787906972.277479:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 233 00000100:00100000:3.0:1787906972.277495:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+27:11646:x1874755972073472:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787906972.277554:0:10853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787906972.279961:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508201c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874756000371840:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00080000:2.0:1787906972.280269:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787906972.280735:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+26:11646:x1874755972073472:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 3237us (3471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906972.280751:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 233 00000100:00100000:0.0:1787906972.291270:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906972.291335:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972073728 00000100:00100000:0.0:1787906972.291349:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972073728 00000100:00100000:0.0:1787906972.291428:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 234 00000100:00100000:0.0:1787906972.291438:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+26:11646:x1874755972073728:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787906972.291486:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906972.291513:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae202 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef9ba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906972.291697:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906972.291714:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906972.291730:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906972.291764:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787906972.292083:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae202 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ba expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906972.292113:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ba expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906972.292123:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:0.0:1787906972.292126:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906972.292132:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f800, rc 0) 00000100:00100000:0.0:1787906972.292234:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+28:11646:x1874755972073728:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 796us (983us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1787906972.292242:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 234 00010000:00010000:0.0:1787906972.331983:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906972.332092:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906972.332197:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906972.335746:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972074112 00000100:00100000:2.0:1787906972.335772:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972074112 00000100:00100000:2.0:1787906972.335894:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 235 00000100:00100000:2.0:1787906972.335908:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+28:11646:x1874755972074112:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787906972.336042:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae217 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.336067:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae217 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.336101:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae217 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.336400:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae217 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.336410:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae217 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.336419:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae217 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.336424:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96c00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906972.336430:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae217 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.336437:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae217 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.336455:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:2.0:1787906972.336458:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787906972.336464:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae217 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.336480:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae217 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906972.336732:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+29:11646:x1874755972074112:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 825us (4532us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787906972.336744:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 235 00000040:00080000:2.0:1787906972.336986:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787906972.336994:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787906972.337469:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787906972.337478:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787906972.341078:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972073856 00000100:00100000:3.0:1787906972.341105:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972073856 00000100:00100000:3.0:1787906972.341235:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:3.0:1787906972.341250:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+29:2345:x1874755972073856:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787906972.341281:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906972.341329:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9ba expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906972.341358:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:3.0:1787906972.341365:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906972.341470:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+28:2345:x1874755972073856:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 223us (9387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906972.341479:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:3.0:1787906972.341568:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906972.344877:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972074368 00000100:00100000:3.0:1787906972.344902:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972074368 00000100:00100000:3.0:1787906972.345013:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:3.0:1787906972.345027:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+28:11646:x1874755972074368:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787906972.354857:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+29:11646:x1874755972074368:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 9814us (13270us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787906972.354876:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000040:00080000:0.0:1787906972.503018:0:12575:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787906972.503036:0:12575:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787906972.503137:0:12575:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787906972.503146:0:12575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787906972.718345:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906972.718436:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972074624 00000100:00100000:2.0:1787906972.718452:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972074624 00000100:00100000:2.0:1787906972.718553:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 236 00000100:00100000:2.0:1787906972.718569:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+29:11659:x1874755972074624:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787906972.718615:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787906972.718651:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae21e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef9c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.718868:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae225 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.718889:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.718906:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787906972.718923:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787906972.719123:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96c00/0x72bb6cf063cae21e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9c1 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.719148:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9c1 expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.719158:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:2.0:1787906972.719161:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787906972.719184:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96a00, rc 0) 00000100:00100000:2.0:1787906972.721349:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+31:11659:x1874755972074624:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 2763us (3002us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787906972.721368:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 236 00000100:00100000:3.0:1787906972.723883:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906972.724397:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972074752 00000100:00100000:2.0:1787906972.724414:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972074752 00000100:00100000:2.0:1787906972.724509:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 237 00000100:00100000:2.0:1787906972.724523:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+31:11659:x1874755972074752:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:2.0:1787906972.725372:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae233 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.725401:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.725416:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.725457:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.725465:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae233 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.725474:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.725480:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787906972.725486:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.725495:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae233 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.725528:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:2.0:1787906972.725531:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787906972.725537:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae233 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906972.725544:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c97000/0x72bb6cf063cae233 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787906972.725728:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+31:11659:x1874755972074752:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 1204us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906972.725738:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 237 00000100:00100000:1.0:1787906972.857773:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906972.858101:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972074880 00000100:00100000:3.0:1787906972.858116:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972074880 00000100:00100000:3.0:1787906972.858266:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:3.0:1787906972.858281:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2343:x1874755972074880:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:3.0:1787906972.858308:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787906972.858358:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d071e261/0x72bb6cf063cae23a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef9c8 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787906972.858401:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a914b99, atime: 0x6a914b99, ctime: 0x6a914b99, blocks: 0xb 00010000:00010000:3.0:1787906972.858439:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=411s v=(0 0) 00010000:00010000:3.0:1787906972.858445:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787906972.858458:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d071e261/0x72bb6cf063cae23a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9c8 expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906972.858510:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d071e261/0x72bb6cf063cae23a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9c8 expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906972.858527:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500030000, rc 0) 00000100:00100000:3.0:1787906972.858610:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2343:x1874755972074880:12345-192.168.204.20@tcp:101:cat.0 Request processed in 332us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906972.858617:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00080000:2.0:1787906972.859022:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787906972.864275:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906972.864619:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972075008 00000100:00100000:2.0:1787906972.864633:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972075008 00002000:00100000:2.0:1787906972.864704:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8aa507d38e00 x1874755972075008/t0(0) o3->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:543/0 lens 488/0 e 0 to 0 dl 1787906983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787906972.864720:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa507d38e00 with x1874755972075008 ext(0->4095) 00002000:00010000:2.0:1787906972.864728:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa507d38e00 00000100:00100000:3.0:1787906972.864869:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1787906972.864887:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2344:x1874755972075008:12345-192.168.204.20@tcp:3:cat.0 00000100:00100000:3.0:1787906972.865518:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2344:x1874755972075008:12345-192.168.204.20@tcp:3:cat.0 Request processed in 633us (1260us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787906972.865529:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00002000:00100000:3.0:1787906972.865538:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8aa507d38e00 x1874755972075008/t0(0) o3->419aebcc-abec-417c-9cd3-22c347ab3c27@192.168.204.20@tcp:543/0 lens 488/4536 e 0 to 0 dl 1787906983 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787906972.865547:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa507d38e00 with x1874755972075008 ext(0->4095) 00002000:00010000:3.0:1787906972.865552:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8aa507d38e00 00010000:00010000:2.0:1787906973.344060:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906974.369057:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000371968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787906974.369162:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906974.369268:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000371968 00000100:00100000:0.0:1787906974.369277:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000371968 00000100:00100000:0.0:1787906974.369354:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787906974.369367:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000371968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787906974.369434:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906974.369490:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000371968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906974.369498:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1787906974.369524:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906974.369561:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787906974.369568:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1787906974.369602:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa5347a7480, transno 4294967310 00000100:00100000:0.0:1787906974.369626:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000371968:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787906974.370249:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906975.398007:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906975.754611:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906975.754658:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906975.754690:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906975.754763:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906975.754798:0:11686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972075136 00000100:00100000:1.0:1787906975.754852:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972075648 00000100:00100000:1.0:1787906975.754865:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972075648 00000100:00100000:0.0:1787906975.754866:0:11686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972075136 00000100:00100000:1.0:1787906975.754958:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972075264 00000100:00100000:1.0:1787906975.754963:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972075264 00000100:00100000:0.0:1787906975.754990:0:11686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 310 00000100:00100000:1.0:1787906975.755012:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00100000:0.0:1787906975.755014:0:11686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755972075136:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906975.755028:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755972075648:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906975.755121:0:11686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755972075136:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 118us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906975.755132:0:11686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 310 00000100:00100000:2.0:1787906975.755138:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 185 00000100:00100000:2.0:1787906975.755155:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+31:2345:x1874755972075264:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787906975.755243:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972075392 00000100:00100000:3.0:1787906975.755249:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972075392 00000100:00100000:3.0:1787906975.755302:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 107 00000100:00100000:3.0:1787906975.755310:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2345:x1874755972075392:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906975.762012:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2345:x1874755972075648:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 6971us (7301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906975.762034:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00080000:1.0:1787906975.762605:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787906975.762615:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906975.762996:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+31:2345:x1874755972075264:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 7840us (8224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906975.763009:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 185 00000100:00100000:0.0:1787906975.763995:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906975.764042:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972075520 00000100:00100000:0.0:1787906975.764051:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972075520 00000100:00100000:0.0:1787906975.764118:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 108 00000100:00100000:0.0:1787906975.764132:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2345:x1874755972075520:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906975.764227:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+8:2345:x1874755972075520:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 98us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906975.764234:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 108 00000100:00080000:1.0:1787906975.764383:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787906975.766112:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2345:x1874755972075392:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 10780us (11429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906975.766156:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 107 00010000:00010000:2.0:1787906976.416415:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906976.421534:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000372224:0@lo:400:kworker.0 00000100:00100000:1.0:1787906976.421668:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906976.421766:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f7b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000372736:0@lo:400:kworker.0 00000100:00100000:1.0:1787906976.421803:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906976.421917:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787906976.421928:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000372096:0@lo:400:kworker.0 00000100:00100000:1.0:1787906976.421969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906976.422000:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f7b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000372608:0@lo:400:kworker.0 00000100:00100000:1.0:1787906976.422027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906976.423705:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000372352:0@lo:400:kworker.0 00000100:00100000:0.0:1787906976.423857:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906976.423921:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787906976.423929:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000372480:0@lo:400:kworker.0 00000100:00100000:0.0:1787906976.423963:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906976.424056:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000372224 00000100:00100000:0.0:1787906976.424067:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000372224 00000100:00100000:0.0:1787906976.424124:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000372608 00000100:00100000:0.0:1787906976.424128:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000372608 00000100:00100000:0.0:1787906976.424156:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000372352 00000100:00100000:0.0:1787906976.424160:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000372352 00000100:00100000:0.0:1787906976.424178:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787906976.424188:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000372224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906976.424260:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000372224:12345-0@lo:400:kworker.0 Request processed in 73us (2593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906976.424268:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787906976.424288:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787906976.424293:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000372608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906976.424339:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000372608:12345-0@lo:400:kworker.0 Request processed in 45us (2311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906976.424346:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787906976.424358:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787906976.424364:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5170a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000372352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906976.424395:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5170a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000372352:12345-0@lo:400:kworker.0 Request processed in 31us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906976.424401:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787906976.424422:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000372736 00000100:00100000:0.0:1787906976.424426:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000372736 00000100:00100000:0.0:1787906976.424467:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000372480 00000100:00100000:0.0:1787906976.424470:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000372480 00000100:00100000:0.0:1787906976.424494:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787906976.424499:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5347a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1874756000372736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906976.424537:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5347a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1874756000372736:12345-0@lo:400:kworker.0 Request processed in 37us (2733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906976.424543:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787906976.424554:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787906976.424560:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000372480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906976.424587:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000372480:12345-0@lo:400:kworker.0 Request processed in 27us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906976.424593:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1787906976.424614:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787906976.424619:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787906976.424622:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906976.424664:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f7b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000372608:0@lo:400:kworker.0 00000100:00100000:0.0:1787906976.424680:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000372224:0@lo:400:kworker.0 00000100:00100000:0.0:1787906976.424691:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f7b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000372736:0@lo:400:kworker.0 00000100:00100000:0.0:1787906976.425270:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000372480:0@lo:400:kworker.0 00000100:00100000:0.0:1787906976.425284:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000372352:0@lo:400:kworker.0 00000100:00100000:1.0:1787906976.438498:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000372096 00000100:00100000:1.0:1787906976.438523:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000372096 00000100:00100000:1.0:1787906976.438626:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1787906976.438640:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000372096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906976.438779:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000372096:12345-0@lo:400:kworker.0 Request processed in 142us (16807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906976.438803:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787906976.458308:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000372096:0@lo:400:kworker.0 00000001:00080000:0.0:1787906976.560245:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1787906976.560335:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1787906976.560349:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1787906976.572415:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000001:00080000:0.0:1787906976.572447:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787906976.572489:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa517253300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787906976.572495:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa52ec13200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa5172533c0 00000020:00080000:0.0:1787906976.572509:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8aa52ec13f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa53f801c00 00000020:00080000:0.0:1787906976.572546:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787906976.572737:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787906976.573102:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1787906976.929223:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787906976.929254:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000372864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787906976.929359:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906976.929614:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000372864 00000100:00100000:1.0:1787906976.929625:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000372864 00000100:00100000:1.0:1787906976.929695:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787906976.929707:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000372864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787906976.929757:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787906976.929845:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000372864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906976.929853:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787906976.929921:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787906976.929927:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa535e8bb80, transno 4294967322 00000004:00080000:1.0:1787906976.929938:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787906976.929972:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000372864:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787906977.440459:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906978.464052:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787906978.466359:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787906978.466371:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787906978.466745:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1787906978.466753:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787906978.906107:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906978.910413:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972075776 00000100:00100000:0.0:1787906978.910438:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972075776 00000100:00080000:1.0:1787906978.910716:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906978.910773:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 238 00000100:00100000:0.0:1787906978.910793:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+18:11321:x1874755972075776:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787906978.910981:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+18:11321:x1874755972075776:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 Request processed in 196us (4892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906978.910991:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 238 00000100:00100000:0.0:1787906978.925562:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906978.925713:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972076032 00000100:00100000:3.0:1787906978.925727:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972076032 00000100:00100000:3.0:1787906978.925807:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:3.0:1787906978.925879:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+18:11321:x1874755972076032:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787906978.926527:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+19:11321:x1874755972076032:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 648us (974us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787906978.926537:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:1.0:1787906979.287039:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906979.287224:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972076160 00000100:00100000:0.0:1787906979.287239:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972076160 00000100:00100000:0.0:1787906979.287346:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 239 00000100:00100000:0.0:1787906979.287360:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:12110:x1874755972076160:12345-192.168.204.20@tcp:101:lsof.0 00010000:00010000:0.0:1787906979.287396:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787906979.287430:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae241 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef9cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906979.287524:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae248 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906979.287543:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae248 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906979.287560:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae248 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787906979.287936:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787906979.287941:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787906979.288259:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae248 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906979.288295:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e600/0x72bb6cf063cae241 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9cf expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906979.288318:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae248 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9cf expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906979.288328:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa510860c00) 00010000:00010000:0.0:1787906979.288332:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787906979.288336:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f800, rc 0) 00000100:00080000:1.0:1787906979.288492:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906979.288535:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:12110:x1874755972076160:12345-192.168.204.20@tcp:101:lsof.0 Request processed in 1177us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906979.288543:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 239 00000100:00100000:1.0:1787906979.488306:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000372992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787906979.488423:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787906979.488940:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906979.491611:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000372992 00000100:00100000:2.0:1787906979.491631:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000372992 00000100:00100000:2.0:1787906979.491854:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787906979.491868:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000372992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787906979.491926:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906979.492060:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000372992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (3637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906979.492068:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1787906979.493017:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787906979.495432:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000372992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787906980.512159:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906980.875757:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906980.875856:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972076416 00000100:00100000:0.0:1787906980.875871:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972076416 00000100:00100000:2.0:1787906980.875885:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906980.875920:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906980.875947:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906980.875974:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 189 00000100:00100000:2.0:1787906980.875985:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906980.875992:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+19:2345:x1874755972076416:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906980.876013:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972076800 00000100:00100000:2.0:1787906980.876018:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972076800 00000100:00100000:2.0:1787906980.876053:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 190 00000100:00100000:2.0:1787906980.876063:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:2345:x1874755972076800:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787906980.876161:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972076672 00000100:00100000:1.0:1787906980.876166:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972076672 00000100:00100000:1.0:1787906980.876199:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972076544 00000100:00100000:1.0:1787906980.876202:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972076544 00000100:00100000:1.0:1787906980.876226:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 111 00000100:00100000:1.0:1787906980.876234:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972076672:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906980.876245:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:2345:x1874755972076800:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 183us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906980.876255:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 190 00000100:00100000:1.0:1787906980.876291:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2345:x1874755972076672:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 57us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906980.876300:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 111 00000100:00100000:1.0:1787906980.876317:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 112 00000100:00100000:1.0:1787906980.876324:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2345:x1874755972076544:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906980.876335:0:11686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972076288 00000100:00100000:2.0:1787906980.876340:0:11686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972076288 00000100:00100000:1.0:1787906980.876353:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2345:x1874755972076544:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906980.876361:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 112 00000100:00100000:2.0:1787906980.876378:0:11686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 312 00000100:00100000:2.0:1787906980.876387:0:11686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755972076288:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906980.876419:0:11686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+13:2345:x1874755972076288:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 34us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906980.876425:0:11686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 312 00000100:00100000:0.0:1787906980.876652:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+19:2345:x1874755972076416:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 116us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906980.876661:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 189 00000100:00080000:3.0:1787906980.876809:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787906980.876835:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787906980.876838:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787906981.536125:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906981.552011:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787906981.552041:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000373120:0@lo:400:kworker.0 00000100:00100000:1.0:1787906981.552120:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906981.552187:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000373120 00000100:00100000:1.0:1787906981.552197:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000373120 00000100:00100000:1.0:1787906981.552254:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787906981.552263:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000373120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906981.552601:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3304:x1874756000373120:12345-0@lo:400:kworker.0 Request processed in 336us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906981.552610:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787906981.552736:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17707cff-d1ec-407e-b5de-6f2bf29614ad:3304:1874756000373120:0@lo:400:kworker.0 00000100:00100000:1.0:1787906981.552923:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000373248:0@lo:400:kworker.0 00000100:00100000:1.0:1787906981.552960:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906981.552998:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000373248 00000100:00100000:1.0:1787906981.553003:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000373248 00000100:00100000:1.0:1787906981.553034:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787906981.553040:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000373248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906981.553089:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000373248:12345-0@lo:400:kworker.0 Request processed in 48us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906981.553096:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787906981.553122:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000373248:0@lo:400:kworker.0 00000100:00100000:1.0:1787906981.553161:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000373376:0@lo:400:kworker.0 00000100:00100000:1.0:1787906981.553185:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906981.553213:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000373376 00000100:00100000:1.0:1787906981.553217:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000373376 00000100:00100000:1.0:1787906981.553246:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787906981.553252:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000373376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906981.553287:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000373376:12345-0@lo:400:kworker.0 Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906981.553292:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:1.0:1787906981.553306:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906981.554417:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000373760:0@lo:400:kworker.0 00000100:00100000:2.0:1787906981.554448:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000373632:0@lo:400:kworker.0 00000100:00100000:3.0:1787906981.554544:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000373504:0@lo:400:kworker.0 00000100:00100000:1.0:1787906981.555624:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000373376:0@lo:400:kworker.0 00000100:00100000:2.0:1787906981.557570:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906981.557729:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000373632 00000100:00100000:1.0:1787906981.557739:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000373632 00000100:00100000:1.0:1787906981.557871:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787906981.557882:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000373632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906981.557947:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000373632:12345-0@lo:400:kworker.0 Request processed in 67us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906981.557955:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787906981.557995:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000373632:0@lo:400:kworker.0 00000100:00080000:2.0:1787906981.561121:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906981.569184:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906981.571026:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000373760 00000100:00100000:2.0:1787906981.571045:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000373760 00000100:00100000:2.0:1787906981.571121:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787906981.571134:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000373760:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787906981.571338:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787906981.571904:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000373760:12345-0@lo:400:kworker.0 Request processed in 769us (2728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906981.571914:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787906981.571972:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000373760:0@lo:400:kworker.0 00000100:00100000:3.0:1787906981.574867:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906981.575019:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000373504 00000100:00100000:2.0:1787906981.575028:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000373504 00000100:00100000:2.0:1787906981.575143:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787906981.575155:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000373504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906981.575219:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000373504:12345-0@lo:400:kworker.0 Request processed in 67us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906981.575226:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787906981.575292:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000373504:0@lo:400:kworker.0 00000100:00080000:3.0:1787906981.575484:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1787906981.602858:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1787906981.602902:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1787906981.603012:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787906981.603025:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1787906982.055540:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000373888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787906982.055649:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906982.055915:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000373888 00000100:00100000:0.0:1787906982.055925:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000373888 00000100:00100000:0.0:1787906982.055975:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787906982.055985:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000373888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787906982.056025:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787906982.062780:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000373888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787906982.063252:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000373888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7263us (7598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906982.063263:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:0.0:1787906982.560368:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787906982.675324:0:12775:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:49:41 (1787906981) 00010000:00010000:3.0:1787906983.583959:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906984.608171:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906984.608950:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000374016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787906984.609035:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906984.609413:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000374016 00000100:00100000:0.0:1787906984.609422:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000374016 00000100:00100000:0.0:1787906984.609491:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787906984.609501:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000374016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787906984.609539:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906984.609590:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000374016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906984.609597:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1787906984.609631:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906984.609651:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000374016:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787906985.635583:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906985.999171:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906985.999219:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906985.999262:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906985.999285:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906985.999325:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906986.000761:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972077312 00000100:00100000:0.0:1787906986.000773:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972077312 00000100:00100000:1.0:1787906986.001005:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972077056 00000100:00100000:1.0:1787906986.001011:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972077056 00000100:00100000:2.0:1787906986.002093:0:11686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972076928 00000100:00100000:2.0:1787906986.002102:0:11686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972076928 00000100:00100000:2.0:1787906986.002157:0:11686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 314 00000100:00100000:2.0:1787906986.002169:0:11686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755972076928:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906986.002247:0:11686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+13:2346:x1874755972076928:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 80us (2984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906986.002255:0:11686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 314 00000100:00100000:2.0:1787906986.002588:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972077184 00000100:00100000:2.0:1787906986.002594:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972077184 00000100:00100000:2.0:1787906986.004284:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:2.0:1787906986.004301:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755972077184:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906986.004381:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2346:x1874755972077184:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 85us (5093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906986.004388:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00080000:2.0:1787906986.004457:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787906986.004463:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787906986.004466:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787906986.004512:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972077440 00000100:00100000:1.0:1787906986.004519:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972077440 00000100:00080000:2.0:1787906986.004539:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906986.004548:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 194 00000100:00100000:2.0:1787906986.004555:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 195 00000100:00100000:1.0:1787906986.004556:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+18:2346:x1874755972077056:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906986.004562:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:2346:x1874755972077440:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787906986.004638:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:2346:x1874755972077440:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 76us (5312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906986.004645:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 195 00000100:00100000:1.0:1787906986.004895:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+18:2346:x1874755972077056:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 340us (5735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906986.004902:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 194 00000100:00100000:0.0:1787906986.012146:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:0.0:1787906986.012163:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972077312:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787906986.012275:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2346:x1874755972077312:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 117us (13054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906986.012282:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:2.0:1787906986.656559:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000374272:0@lo:400:kworker.0 00000100:00100000:1.0:1787906986.656561:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000374144:0@lo:400:kworker.0 00000100:00100000:0.0:1787906986.656652:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000374528:0@lo:400:kworker.0 00000100:00100000:3.0:1787906986.657627:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000374400:0@lo:400:kworker.0 00000100:00100000:2.0:1787906986.658347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906986.658419:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000374784:0@lo:400:kworker.0 00000100:00100000:2.0:1787906986.658452:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906986.658507:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000374272 00000100:00100000:2.0:1787906986.658517:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000374272 00000100:00100000:2.0:1787906986.658586:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787906986.658597:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000374272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906986.659899:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906986.660037:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000374784 00000100:00100000:0.0:1787906986.660044:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000374784 00000100:00100000:0.0:1787906986.660095:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000374528 00000100:00100000:0.0:1787906986.660098:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000374528 00000100:00100000:0.0:1787906986.660119:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787906986.660128:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000374784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906986.660239:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874756000374272:12345-0@lo:400:kworker.0 Request processed in 1643us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906986.660248:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787906986.661188:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906986.661472:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000374400 00000100:00100000:1.0:1787906986.661482:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000374400 00000100:00100000:1.0:1787906986.661534:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787906986.661544:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000374400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906986.661594:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000374400:12345-0@lo:400:kworker.0 Request processed in 53us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906986.661601:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787906986.661637:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906986.661662:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000374144 00000100:00100000:1.0:1787906986.661666:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000374144 00000100:00100000:3.0:1787906986.662388:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000374400:0@lo:400:kworker.0 00010000:00010000:3.0:1787906986.662482:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906986.662667:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787906986.662691:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508201c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000374528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787906986.662756:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508201c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000374528:12345-0@lo:400:kworker.0 Request processed in 69us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906986.662763:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787906986.664610:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000374784:12345-0@lo:400:kworker.0 Request processed in 4468us (6141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906986.664629:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1787906986.665205:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787906986.665212:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787906986.665215:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787906986.665263:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000374528:0@lo:400:kworker.0 00000100:00100000:0.0:1787906986.665326:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000374656:0@lo:400:kworker.0 00000100:00100000:0.0:1787906986.665386:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906986.665607:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000374656 00000100:00100000:0.0:1787906986.665616:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000374656 00000100:00100000:0.0:1787906986.665687:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787906986.665697:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000374656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906986.666063:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000374656:12345-0@lo:400:kworker.0 Request processed in 367us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906986.666071:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1787906986.666244:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906986.666275:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000374656:0@lo:400:kworker.0 00000100:00100000:0.0:1787906986.666352:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787906986.666378:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000374144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906986.666424:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000374144:12345-0@lo:400:kworker.0 Request processed in 48us (4786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906986.666430:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787906986.666473:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000374144:0@lo:400:kworker.0 00000100:00100000:2.0:1787906986.669409:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874756000374272:0@lo:400:kworker.0 00000100:00100000:2.0:1787906986.669443:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000374784:0@lo:400:kworker.0 00000100:00100000:3.0:1787906987.168201:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000374912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787906987.168296:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906987.168695:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000374912 00000100:00100000:2.0:1787906987.168707:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000374912 00000100:00100000:2.0:1787906987.168803:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787906987.168850:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000374912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787906987.168899:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787906987.168969:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000374912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906987.168977:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787906987.169452:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000374912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787906987.456107:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906987.456195:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972077696 00000100:00100000:3.0:1787906987.456207:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972077696 00000100:00100000:3.0:1787906987.456267:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:3.0:1787906987.456278:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+18:12332:x1874755972077696:12345-192.168.204.20@tcp:35:umount.0 00000100:00100000:3.0:1787906987.457095:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+19:12332:x1874755972077696:12345-192.168.204.20@tcp:35:umount.0 Request processed in 816us (995us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787906987.457113:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:1.0:1787906987.465088:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906987.466988:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972077952 00000100:00100000:2.0:1787906987.467004:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972077952 00000100:00100000:2.0:1787906987.467078:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:2.0:1787906987.467089:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+19:12332:x1874755972077952:12345-192.168.204.20@tcp:35:umount.0 00000100:00100000:2.0:1787906987.467486:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419aebcc-abec-417c-9cd3-22c347ab3c27+20:12332:x1874755972077952:12345-192.168.204.20@tcp:35:umount.0 Request processed in 398us (2409us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787906987.467494:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:2.0:1787906987.473435:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906987.474336:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972078208 00000100:00100000:3.0:1787906987.474350:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972078208 00000100:00100000:3.0:1787906987.474422:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:3.0:1787906987.474433:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa52939a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+20:12332:x1874755972078208:12345-192.168.204.20@tcp:35:umount.0 00000100:00100000:3.0:1787906987.474982:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa52939a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+21:12332:x1874755972078208:12345-192.168.204.20@tcp:35:umount.0 Request processed in 547us (1555us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787906987.474990:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:3.0:1787906987.478586:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906987.480327:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972078464 00000100:00100000:0.0:1787906987.480340:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972078464 00000100:00100000:0.0:1787906987.480411:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:0.0:1787906987.480423:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+21:12332:x1874755972078464:12345-192.168.204.20@tcp:35:umount.0 00000100:00100000:0.0:1787906987.481015:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419aebcc-abec-417c-9cd3-22c347ab3c27+22:12332:x1874755972078464:12345-192.168.204.20@tcp:35:umount.0 Request processed in 592us (2435us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787906987.481023:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:1.0:1787906987.487793:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906987.487898:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906987.488116:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972078592 00000100:00100000:2.0:1787906987.488127:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972078592 00000100:00100000:2.0:1787906987.488203:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972078720 00000100:00100000:2.0:1787906987.488206:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972078720 00000100:00100000:2.0:1787906987.488228:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:2.0:1787906987.488237:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9eec00eb-d19d-4892-ad44-299469e66291+14:2343:x1874755972078592:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906987.488254:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906987.488274:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa508210e00/0x72bb6cf063cad2c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef55a expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906987.488293:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906987.488350:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9eec00eb-d19d-4892-ad44-299469e66291+13:2343:x1874755972078592:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 113us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906987.488358:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:2.0:1787906987.488375:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:2.0:1787906987.488381:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5030a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9eec00eb-d19d-4892-ad44-299469e66291+12:2343:x1874755972078720:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787906987.488389:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787906987.488398:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511994800/0x72bb6cf063cad226 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef522 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787906987.488425:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787906987.488444:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5030a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9eec00eb-d19d-4892-ad44-299469e66291+11:2343:x1874755972078720:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 63us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906987.488451:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:3.0:1787906987.490075:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906987.490183:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972079232 00000100:00100000:0.0:1787906987.490196:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972079232 00000100:00100000:0.0:1787906987.490256:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:0.0:1787906987.490266:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f788700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9eec00eb-d19d-4892-ad44-299469e66291+11:2343:x1874755972079232:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906987.490283:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906987.490301:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cad4aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef625 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906987.490317:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906987.490372:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f788700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9eec00eb-d19d-4892-ad44-299469e66291+10:2343:x1874755972079232:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 108us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906987.490380:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:2.0:1787906987.490584:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906987.490960:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972079104 00000100:00100000:3.0:1787906987.490966:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972079104 00000100:00100000:3.0:1787906987.491005:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:3.0:1787906987.491013:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+7:2342:x1874755972079104:12345-192.168.204.20@tcp:9:umount.0 00000020:00000080:3.0:1787906987.491043:0:6675:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad7f9 00000020:00010000:3.0:1787906987.491050:0:6675:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8aa532273000: total 0 00000100:00080000:3.0:1787906987.491054:0:6675:0:(import.c:65:import_set_state_nolock()) ffff8aa532277800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787906987.491102:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787906987.491415:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2342:x1874755972079104:12345-192.168.204.20@tcp:9:umount.0 Request processed in 402us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906987.491422:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00000020:00010000:1.0:1787906987.491494:0:5818:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8aa532273000: total 0 00010000:00010000:1.0:1787906987.491529:0:5818:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8aa532273000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787906987.491586:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a96e189/0x72bb6cf063cadb9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7fa expref: 4 pid: 8459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906987.491666:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d071e261/0x72bb6cf063cae23a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9c8 expref: 3 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906987.491686:0:5818:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8aa532273000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787906987.491699:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906987.491701:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906987.491703:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906987.506797:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906987.507155:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972079360 00000100:00100000:0.0:1787906987.507195:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972079360 00000100:00100000:0.0:1787906987.507261:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:0.0:1787906987.507274:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+5:2342:x1874755972079360:12345-192.168.204.20@tcp:9:umount.0 00000020:00000080:0.0:1787906987.507488:0:8459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad598 00000100:00080000:0.0:1787906987.507498:0:8459:0:(import.c:65:import_set_state_nolock()) ffff8aa532271800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787906987.507547:0:8459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1787906987.507941:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787906987.508032:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+2:2342:x1874755972079360:12345-192.168.204.20@tcp:9:umount.0 Request processed in 760us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906987.508041:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:2.0:1787906987.514912:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787906987.515005:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972080384 00000100:00100000:3.0:1787906987.515016:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972080384 00000100:00100000:3.0:1787906987.515082:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 240 00000100:00100000:3.0:1787906987.515107:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+22:2342:x1874755972080384:12345-192.168.204.20@tcp:39:umount.0 00000020:00000080:3.0:1787906987.515144:0:10853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad234 00000020:00010000:3.0:1787906987.515160:0:10853:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8aa510320800: total 0 00000100:00080000:3.0:1787906987.515165:0:10853:0:(import.c:65:import_set_state_nolock()) ffff8aa510321800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787906987.515201:0:10853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1787906987.515675:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419aebcc-abec-417c-9cd3-22c347ab3c27+21:2342:x1874755972080384:12345-192.168.204.20@tcp:39:umount.0 Request processed in 569us (772us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787906987.515684:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 240 00000020:00010000:0.0:1787906987.516847:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8aa510320800: total 0 00010000:00010000:0.0:1787906987.516913:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8aa510320800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787906987.516964:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:0.0:1787906987.516969:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906987.516980:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211400/0x72bb6cf063cadb5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7e5 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906987.517004:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:0.0:1787906987.517007:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787906987.517011:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030800/0x72bb6cf063cae1fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9b3 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906987.517025:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa510860c00) 00010000:00010000:0.0:1787906987.517027:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787906987.517031:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e800/0x72bb6cf063cadbfe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef816 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906987.517043:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa518965b00) 00010000:00010000:0.0:1787906987.517045:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787906987.517062:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508211c00/0x72bb6cf063cad51a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef63a expref: 17 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906987.517086:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8aa510860200) 00010000:00010000:0.0:1787906987.517088:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787906987.517092:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8fc00/0x72bb6cf063cad4fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef633 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906987.517110:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:0.0:1787906987.517112:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787906987.517117:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500031200/0x72bb6cf063cadb87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7f3 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906987.517130:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:0.0:1787906987.517132:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787906987.517135:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96a00/0x72bb6cf063cae225 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9c1 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906987.517145:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa5069caa00) 00010000:00010000:0.0:1787906987.517147:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787906987.517150:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa500030200/0x72bb6cf063cae11b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef97b expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906987.517164:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:0.0:1787906987.517167:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787906987.518406:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8e000/0x72bb6cf063cad85b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef721 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906987.518454:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:0.0:1787906987.518470:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787906987.518481:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f400/0x72bb6cf063cadc1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef81d expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906987.518499:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa510860000) 00010000:00010000:0.0:1787906987.518501:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787906987.518505:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa541c96000/0x72bb6cf063cadef9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef8ef expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906987.518520:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa5069aa000) 00010000:00010000:0.0:1787906987.518522:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787906987.518525:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210400/0x72bb6cf063cada7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef7ad expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906987.518540:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa518965200) 00010000:00010000:0.0:1787906987.518542:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787906987.518546:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa508210c00/0x72bb6cf063cad56e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef64f expref: 8 pid: 10853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906987.518562:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8aa510320800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787906987.518594:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906987.518596:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906987.518598:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906987.680109:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906988.705014:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787906988.705336:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787906988.705343:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787906988.705721:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787906988.705728:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787906989.687440:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906989.687550:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787906989.690655:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906989.691564:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972080512 00000100:00100000:0.0:1787906989.691582:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972080512 00000100:00100000:0.0:1787906989.691667:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972080768 00000100:00100000:0.0:1787906989.691671:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972080768 00000100:00100000:0.0:1787906989.691704:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:0.0:1787906989.691714:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9eec00eb-d19d-4892-ad44-299469e66291+11:2346:x1874755972080512:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906989.691752:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906989.691777:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511995600/0x72bb6cf063cad306 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef56f expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906989.691794:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906989.691885:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9eec00eb-d19d-4892-ad44-299469e66291+10:2346:x1874755972080512:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 172us (4463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906989.691893:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:0.0:1787906989.691911:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:0.0:1787906989.691918:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9eec00eb-d19d-4892-ad44-299469e66291+9:2346:x1874755972080768:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906989.691927:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906989.691936:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cad4a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef61e expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906989.691945:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906989.691962:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9eec00eb-d19d-4892-ad44-299469e66291+8:2346:x1874755972080768:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 45us (4413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906989.691967:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:0.0:1787906989.696307:0:8506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972080640 00000100:00100000:0.0:1787906989.696330:0:8506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972080640 00000100:00100000:0.0:1787906989.696418:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:0.0:1787906989.696441:0:8506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9eec00eb-d19d-4892-ad44-299469e66291+8:2346:x1874755972080640:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787906989.696477:0:8506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787906989.696505:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511994e00/0x72bb6cf063cad30d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef599 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906989.696527:0:8506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787906989.696628:0:8506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9eec00eb-d19d-4892-ad44-299469e66291+7:2346:x1874755972080640:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 199us (5986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906989.696638:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:0.0:1787906989.697412:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787906989.697477:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972081024 00000100:00100000:1.0:1787906989.697485:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972081024 00000100:00100000:1.0:1787906989.697544:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 241 00000100:00100000:1.0:1787906989.697554:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+6:2342:x1874755972081024:12345-192.168.204.20@tcp:39:umount.0 00000020:00000080:1.0:1787906989.697593:0:5830:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad31b 00000020:00010000:1.0:1787906989.697602:0:5830:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8aa534c9a800: total 0 00000100:00080000:1.0:1787906989.697606:0:5830:0:(import.c:65:import_set_state_nolock()) ffff8aa534c9e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787906989.697665:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1787906989.697912:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0090c414-ebc1-4e0b-a520-0378a8ae450c+5:2342:x1874755972081024:12345-192.168.204.20@tcp:39:umount.0 Request processed in 360us (503us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787906989.697920:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 241 00000020:00010000:3.0:1787906989.698001:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8aa534c9a800: total 0 00010000:00010000:3.0:1787906989.698006:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906989.698049:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8aa534c9a800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787906989.698081:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa510860c00) 00010000:00010000:3.0:1787906989.698085:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787906989.698092:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa53ac8f800/0x72bb6cf063cae248 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9cf expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906989.698112:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8aa534c9a800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787906989.698122:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906989.698124:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906989.698126:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787906989.698239:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787906989.724997:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787906989.725273:0:11686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972081280 00000100:00100000:0.0:1787906989.725286:0:11686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972081280 00000100:00100000:0.0:1787906989.725368:0:11686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 316 00000100:00100000:0.0:1787906989.725379:0:11686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+7:2342:x1874755972081280:12345-192.168.204.20@tcp:251:umount.0 00000020:00000080:0.0:1787906989.725447:0:11686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad211 00000020:00010000:0.0:1787906989.725456:0:11686:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8aa5170c7800: total 0 00000100:00080000:0.0:1787906989.725461:0:11686:0:(import.c:65:import_set_state_nolock()) ffff8aa5170c4000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787906989.725577:0:11686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9eec00eb-d19d-4892-ad44-299469e66291+3:2342:x1874755972081280:12345-192.168.204.20@tcp:251:umount.0 Request processed in 199us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906989.725586:0:11686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 316 00000020:00010000:1.0:1787906989.725888:0:5818:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8aa5170c7800: total 0 00010000:00010000:1.0:1787906989.725940:0:5818:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8aa5170c7800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787906989.725977:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cad2c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef561 expref: 2 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906989.726009:0:5818:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8aa5170c7800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787906989.726018:0:5818:0:(genops.c:885:class_export_put()) final put ffff8aa5170c7800/9eec00eb-d19d-4892-ad44-299469e66291 00010000:00010000:1.0:1787906989.726033:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906989.726035:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906989.726037:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787906989.726166:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa5170c7800/9eec00eb-d19d-4892-ad44-299469e66291 for MGS 00000020:00000080:3.0:1787906989.726205:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa5170c4000 for MGS 00010000:00010000:3.0:1787906989.729164:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787906989.729521:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa510b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000375040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787906989.729621:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906989.730021:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000375040 00000100:00100000:0.0:1787906989.730031:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000375040 00000100:00080000:1.0:1787906989.730260:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787906989.730356:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787906989.730368:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000375040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787906989.730408:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787906989.730468:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000375040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906989.730475:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787906989.730561:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa510b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000375040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787906990.752339:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787906991.776051:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa5347a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000375424:0@lo:400:kworker.0 00000100:00100000:2.0:1787906991.776139:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906991.776199:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787906991.776205:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000375552:0@lo:400:kworker.0 00000100:00100000:2.0:1787906991.776246:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787906991.776298:0:10853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000375424 00000100:00100000:2.0:1787906991.776308:0:10853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000375424 00000100:00100000:2.0:1787906991.776365:0:10853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787906991.776606:0:10853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000375424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906991.776670:0:10853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874756000375424:12345-0@lo:400:kworker.0 Request processed in 295us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906991.776677:0:10853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787906991.776726:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa5347a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874756000375424:0@lo:400:kworker.0 00000100:00100000:2.0:1787906991.776762:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000375552 00000100:00100000:2.0:1787906991.776781:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000375552 00000100:00100000:2.0:1787906991.776846:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787906991.776853:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000375552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906991.776890:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000375552:12345-0@lo:400:kworker.0 Request processed in 38us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906991.776898:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787906991.776925:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000375552:0@lo:400:kworker.0 00000100:00100000:0.0:1787906991.777276:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000375168:0@lo:400:kworker.0 00000100:00100000:0.0:1787906991.777315:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906991.777341:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000375680:0@lo:400:kworker.0 00000100:00100000:0.0:1787906991.777365:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906991.777585:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787906991.777593:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000375296:0@lo:400:kworker.0 00000100:00100000:0.0:1787906991.777618:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906991.777636:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000375808:0@lo:400:kworker.0 00000100:00100000:0.0:1787906991.777658:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906991.777709:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000375168 00000100:00100000:0.0:1787906991.777715:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000375168 00000100:00100000:0.0:1787906991.777746:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787906991.777754:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000375168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787906991.777795:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3303:x1874756000375168:12345-0@lo:400:kworker.0 Request processed in 41us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906991.777802:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00080000:1.0:1787906991.778170:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787906991.778176:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787906991.778188:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000375680 00000100:00100000:1.0:1787906991.778192:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000375680 00000100:00100000:1.0:1787906991.778238:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000375296 00000100:00100000:1.0:1787906991.778241:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000375296 00000100:00100000:1.0:1787906991.778255:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787906991.778262:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa510b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000375680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906991.778300:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa510b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000375680:12345-0@lo:400:kworker.0 Request processed in 39us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906991.778307:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787906991.778319:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787906991.778324:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000375296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787906991.778348:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000375296:12345-0@lo:400:kworker.0 Request processed in 24us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906991.778354:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:1.0:1787906991.778370:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787906991.779606:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000375296:0@lo:400:kworker.0 00000100:00100000:0.0:1787906991.779622:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000375168:0@lo:400:kworker.0 00000100:00100000:0.0:1787906991.779633:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000375680:0@lo:400:kworker.0 00000100:00100000:2.0:1787906991.781702:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000375808 00000100:00100000:2.0:1787906991.781716:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000375808 00000100:00100000:2.0:1787906991.781793:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787906991.781805:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000375808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787906991.781928:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000375808:12345-0@lo:400:kworker.0 Request processed in 126us (4268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906991.781935:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787906991.781992:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000375808:0@lo:400:kworker.0 00000100:00080000:1.0:1787906991.786351:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787906991.805543:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787906991.906633:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1787906991.906657:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0090c414-ebc1-4e0b-a520-0378a8ae450c 00000001:00080000:1.0:1787906991.906668:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1787906991.906672:0:5852:0:(genops.c:885:class_export_put()) final put ffff8aa534c9a800/0090c414-ebc1-4e0b-a520-0378a8ae450c 00000001:00100000:1.0:1787906991.906706:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 419aebcc-abec-417c-9cd3-22c347ab3c27 00000001:00080000:1.0:1787906991.906713:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787906991.906720:0:5852:0:(genops.c:885:class_export_put()) final put ffff8aa510320800/419aebcc-abec-417c-9cd3-22c347ab3c27 00000020:00000080:3.0:1787906991.906852:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa534c9a800/0090c414-ebc1-4e0b-a520-0378a8ae450c for lustre-MDT0000 00000020:00000080:3.0:1787906991.906906:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa510320800/419aebcc-abec-417c-9cd3-22c347ab3c27 for lustre-MDT0000 00000020:00000080:3.0:1787906991.907017:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa534c9e000 for lustre-MDT0000 00000020:00000080:3.0:1787906991.907032:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa510321800 for lustre-MDT0000 00000001:00100000:0.0:1787906991.911938:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 419aebcc-abec-417c-9cd3-22c347ab3c27 00000020:00000080:0.0:1787906991.911951:0:7636:0:(genops.c:885:class_export_put()) final put ffff8aa532273000/419aebcc-abec-417c-9cd3-22c347ab3c27 00000020:00000080:0.0:1787906991.913080:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa532273000/419aebcc-abec-417c-9cd3-22c347ab3c27 for lustre-OST0001 00000020:00000080:0.0:1787906991.913148:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa532277800 for lustre-OST0001 00000001:00100000:0.0:1787906991.915937:0:6699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 419aebcc-abec-417c-9cd3-22c347ab3c27 00000020:00000080:0.0:1787906991.915950:0:6699:0:(genops.c:885:class_export_put()) final put ffff8aa532276800/419aebcc-abec-417c-9cd3-22c347ab3c27 00000020:00000080:0.0:1787906991.915989:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa532276800/419aebcc-abec-417c-9cd3-22c347ab3c27 for lustre-OST0000 00000020:00000080:0.0:1787906991.916040:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa532271800 for lustre-OST0000 00000020:01000004:0.0:1787906992.035651:0:12974:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787906992.062337:0:12974:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787906992.062388:0:12974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.062404:0:12974:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.062412:0:12974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.062420:0:12974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.062439:0:12974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787906992.062445:0:12974:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1787906992.062472:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787906992.062478:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.062486:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210200 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906992.062490:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.062499:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906992.062506:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906992.062512:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787906992.062530:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787906992.062532:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787906992.062580:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.062588:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906992.062612:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.062620:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa508210200/0x72bb6cf063cad296 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad29d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.062631:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906992.062633:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906992.062635:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906992.062651:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000375936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787906992.062716:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906992.062784:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000375936 00000100:00100000:3.0:1787906992.062791:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000375936 00000100:00100000:3.0:1787906992.062865:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787906992.062875:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f789c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3301:x1874756000375936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787906992.062890:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906992.062907:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa541c97c00/0x72bb6cf063cad29d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cad296 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.064701:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906992.064789:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f789c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:3301:x1874756000375936:12345-0@lo:103:ldlm_bl.0 Request processed in 1910us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906992.064801:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787906992.064867:0:12974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787906992.064884:0:12974:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787906992.064891:0:12974:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787906992.064915:0:12974:0:(import.c:65:import_set_state_nolock()) ffff8aa520ac8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787906992.065095:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17707cff-d1ec-407e-b5de-6f2bf29614ad:3301:1874756000375936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787906992.067193:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874756000376064:0@lo:39:umount.0 00000100:00100000:3.0:1787906992.067282:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787906992.067663:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000376064 00000100:00100000:1.0:1787906992.067676:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000376064 00000100:00100000:1.0:1787906992.067740:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787906992.067752:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874756000376064:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787906992.067784:0:5831:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad02e 00000100:00080000:1.0:1787906992.067794:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8aa53b0f1000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787906992.067884:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3300:x1874756000376064:12345-0@lo:39:umount.0 Request processed in 134us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787906992.067892:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787906992.067904:0:5831:0:(genops.c:885:class_export_put()) final put ffff8aa53b0f1800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1787906992.068462:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787906992.068474:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53b0f1800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787906992.068690:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa53b0f1000 for lustre-MDT0000 00000100:00080000:3.0:1787906992.068730:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa520ac8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787906992.068752:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874756000376064:0@lo:39:umount.0 00000100:00080000:1.0:1787906992.068864:0:12974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787906992.068868:0:12974:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787906992.068872:0:12974:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787906992.070262:0:12974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070281:0:12974:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070289:0:12974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070312:0:12974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070337:0:12974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787906992.070344:0:12974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070350:0:12974:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070356:0:12974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070362:0:12974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070372:0:12974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787906992.070378:0:12974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070385:0:12974:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070391:0:12974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070397:0:12974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070420:0:12974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787906992.070426:0:12974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031e00/0x72bb6cf063cacf7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070432:0:12974:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031e00/0x72bb6cf063cacf7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070439:0:12974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031e00/0x72bb6cf063cacf7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070446:0:12974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8aa500031e00/0x72bb6cf063cacf7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787906992.070454:0:12974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1787906992.070457:0:12974:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787906992.070485:0:12974:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787906992.070489:0:12974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787906992.070493:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787906992.070498:0:12974:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787906992.070504:0:12974:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8aa534cae800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787906992.070511:0:12974:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8aa53f8c7000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787906992.070516:0:12974:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8aa53b0fcd28) has exports, disconnecting them 00000020:00080000:1.0:1787906992.070521:0:12974:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8aa534cae800), last request at 1787906991 00000020:00000080:1.0:1787906992.070528:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad193 00000100:00080000:1.0:1787906992.070549:0:12974:0:(import.c:65:import_set_state_nolock()) ffff8aa534cac800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787906992.070611:0:12974:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8aa534cae800): rc 0 00000020:00000080:1.0:1787906992.070614:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa534cae800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787906992.070622:0:12974:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8aa53f8c7000), last request at 1787906991 00000020:00000080:1.0:1787906992.070631:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad0c8 00000100:00080000:1.0:1787906992.070637:0:12974:0:(import.c:65:import_set_state_nolock()) ffff8aa53f8c0000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787906992.070644:0:12974:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8aa53f8c7000): rc 0 00000020:00000080:1.0:1787906992.070646:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa53f8c7000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787906992.070655:0:12974:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb866c3b53ae0 00000100:00080000:1.0:1787906992.070673:0:12974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787906992.070676:0:12974:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787906992.070694:0:12974:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787906992.070758:0:12974:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787906992.070779:0:12974:0:(import.c:65:import_set_state_nolock()) ffff8aa508a83000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787906992.070792:0:12974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787906992.070794:0:12974:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1787906992.070808:0:12974:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787906992.070891:0:12974:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787906992.070901:0:12974:0:(import.c:65:import_set_state_nolock()) ffff8aa510325800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787906992.070930:0:12974:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8aa53b0fcd28) has no exports 00010000:00010000:3.0:1787906992.073311:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787906992.073329:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073342:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e400 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906992.073347:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073359:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906992.073366:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906992.073372:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787906992.073375:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1787906992.073379:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1787906992.073442:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073465:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906992.073502:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073509:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e400/0x72bb6cf063cad2a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad2ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073526:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787906992.073530:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073535:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031c00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906992.073538:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073544:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906992.073550:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906992.073554:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787906992.073556:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787906992.073558:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787906992.073582:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073589:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906992.073605:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073621:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cad1cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad1d2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073636:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787906992.073640:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073644:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8fe00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906992.073648:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073654:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906992.073659:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906992.073663:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787906992.073665:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787906992.073667:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787906992.073680:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073685:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906992.073691:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073696:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cad4cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad4d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073715:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787906992.073718:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa500031e00/0x72bb6cf063cacf7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073723:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031e00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906992.073726:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa500031e00/0x72bb6cf063cacf7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073732:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa500031e00/0x72bb6cf063cacf7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906992.073738:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa500031e00/0x72bb6cf063cacf7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906992.073742:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787906992.073744:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787906992.073745:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787906992.073759:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa500031e00/0x72bb6cf063cacf7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073764:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906992.073774:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa500031e00/0x72bb6cf063cacf7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073780:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa500031e00/0x72bb6cf063cacf7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cacf86 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.073790:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906992.073792:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906992.073799:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906992.073847:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000376448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787906992.073944:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906992.074007:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787906992.074013:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000376832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787906992.074043:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906992.074070:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f788e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000376576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787906992.074092:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906992.075393:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787906992.075414:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000376704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787906992.075467:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906992.075518:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000376448 00000100:00100000:3.0:1787906992.075526:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000376448 00000100:00100000:3.0:1787906992.075578:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000376832 00000100:00100000:3.0:1787906992.075581:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000376832 00000100:00100000:3.0:1787906992.075596:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000376576 00000100:00100000:3.0:1787906992.075598:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000376576 00000100:00100000:3.0:1787906992.075608:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000376704 00000100:00100000:3.0:1787906992.075611:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000376704 00000100:00100000:3.0:1787906992.075624:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787906992.075632:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f788380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+21:3302:x1874756000376448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787906992.075645:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906992.075664:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511994600/0x72bb6cf063cad2ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cad2a4 expref: 21 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.075681:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906992.075719:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f788380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+20:3302:x1874756000376448:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906992.075725:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787906992.075756:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787906992.075762:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5030abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+19:3302:x1874756000376832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787906992.075770:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906992.075779:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa542174c00/0x72bb6cf063cacf86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cacf7f expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.075792:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906992.075830:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5030abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+18:3302:x1874756000376832:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906992.075836:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787906992.075875:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787906992.075881:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+17:3303:x1874756000376576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787906992.075888:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906992.075896:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa500030c00/0x72bb6cf063cad1d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cad1cb expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.075908:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906992.075952:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+16:3303:x1874756000376576:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906992.075958:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787906992.075970:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787906992.075976:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+15:3303:x1874756000376704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787906992.075983:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787906992.075991:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa508211800/0x72bb6cf063cad4d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cad4cd expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906992.076000:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787906992.076026:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17707cff-d1ec-407e-b5de-6f2bf29614ad+14:3303:x1874756000376704:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787906992.076032:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1787906992.076058:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906992.076065:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787906992.076075:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa534cae800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787906992.076125:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53f8c7000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787906992.076147:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa534cac800 for lustre-MDT0000 00000020:00000080:3.0:1787906992.076152:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa53f8c0000 for lustre-MDT0000 00000100:00100000:3.0:1787906992.076181:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000376704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787906992.076189:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f788e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17707cff-d1ec-407e-b5de-6f2bf29614ad:3303:1874756000376576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787906992.076835:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000376192:0@lo:9:umount.0 00000100:00100000:3.0:1787906992.076877:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787906992.076903:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000376320:0@lo:9:umount.0 00000100:00100000:3.0:1787906992.076940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787906992.076964:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000376192 00000100:00100000:0.0:1787906992.076977:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000376192 00000100:00100000:3.0:1787906992.076978:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000376832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787906992.076987:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000376448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787906992.077008:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000376320 00000100:00100000:0.0:1787906992.077011:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000376320 00000100:00100000:0.0:1787906992.077042:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787906992.077049:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874756000376192:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787906992.077072:0:6673:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad123 00000100:00080000:0.0:1787906992.077081:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8aa508a86000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787906992.077123:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787906992.077144:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874756000376320:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787906992.077173:0:6675:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad1fc 00000100:00080000:2.0:1787906992.077179:0:6675:0:(import.c:65:import_set_state_nolock()) ffff8aa53b057000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787906992.077230:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787906992.077557:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3300:x1874756000376320:12345-0@lo:9:umount.0 Request processed in 414us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787906992.077577:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787906992.077777:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa510325800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787906992.077796:0:3300:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787906992.077798:0:3300:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787906992.077802:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000376320:0@lo:9:umount.0 00010000:00010000:3.0:1787906992.077839:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906992.081911:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787906992.081997:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787906992.082684:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3300:x1874756000376192:12345-0@lo:9:umount.0 Request processed in 5631us (5801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787906992.082697:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787906992.083033:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa508a83000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787906992.083059:0:3300:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787906992.083078:0:3300:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787906992.083162:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000376192:0@lo:9:umount.0 00000020:00080000:0.0:1787906992.086944:0:12974:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8aa53b0fcd28) has no exports 00000020:00000080:0.0:1787906992.184395:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cacfda 00000020:00000080:0.0:1787906992.184415:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa52f19d000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787906992.184434:0:12974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787906992.184597:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa52f19d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787906992.191444:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787906992.191479:0:12974:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787906992.191485:0:12974:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8aa53b0f8000) has no exports 00000020:00000080:2.0:1787906992.191787:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cacfd3 00000020:00000080:2.0:1787906992.191803:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa535dbf000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787906992.191872:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa535dbf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787906992.191880:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787906992.191886:0:12974:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787906992.191898:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa53b10b000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787906992.191901:0:12974:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53b10b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787906992.191910:0:12974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1787906992.192041:0:12974:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8aa535eeff00 - data ffff8aa530731af8/ffff8aa53ac8a400 00000020:01000000:2.0:1787906992.192217:0:12974:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8aa52090e7e0 - data ffff8aa51e00d5e8/ffff8aa520a67000 00000001:00000004:3.0:1787906992.222052:0:12974:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787906992.349353:0:12974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787906992.349362:0:12974:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787906992.349386:0:12974:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787906992.349390:0:12974:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787906992.350350:0:7108:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787906992.350356:0:7108:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1787906992.350367:0:7108:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787906992.354224:0:12974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787906992.354233:0:12974:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787906992.354270:0:12974:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787906992.354274:0:12974:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787906992.354796:0:7987:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787906992.354802:0:7987:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1787906992.354843:0:7987:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787906992.450394:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cacfa2 00000020:00000080:1.0:1787906992.450416:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa53b0f7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787906992.451521:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cacfb7 00000020:00000080:1.0:1787906992.451529:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa53b10f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787906992.451536:0:12974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787906992.451542:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787906992.451551:0:12974:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787906992.451556:0:12974:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8aa53b0fb370) has no exports 00000004:01000000:1.0:1787906992.451725:0:12974:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787906992.451732:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad1f5 00000020:00000080:1.0:1787906992.451736:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa53b054800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787906992.451740:0:12974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787906992.451743:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787906992.451750:0:12974:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787906992.451752:0:12974:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8aa510bd4d28) has no exports 00000020:00000080:1.0:1787906992.451764:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad1ee 00000020:00000080:1.0:1787906992.451767:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa510320000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787906992.452143:0:12974:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787906992.452148:0:12974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787906992.452152:0:12974:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1787906992.452158:0:12974:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787906992.452160:0:12974:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787906992.452189:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787906992.452195:0:12974:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787906992.452201:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad10e 00000020:00000080:1.0:1787906992.452204:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa53f632800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787906992.452208:0:12974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787906992.452211:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787906992.452213:0:12974:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787906992.452216:0:12974:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8aa5187c8000) has no exports 00000020:00000080:1.0:1787906992.452219:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad107 00000020:00000080:1.0:1787906992.452221:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa508a83800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787906992.452546:0:12974:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787906992.452549:0:12974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787906992.452551:0:12974:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1787906992.452554:0:12974:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787906992.452555:0:12974:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787906992.452591:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787906992.452595:0:12974:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787906992.452618:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787906992.452620:0:12974:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787906992.452643:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cacfbe 00000020:00000080:1.0:1787906992.452648:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa53b108000/lustre-MDD0000_UUID 00000020:01000000:1.0:1787906992.452656:0:12974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787906992.452660:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787906992.452662:0:12974:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787906992.452664:0:12974:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8aa53b0f99b8) has no exports 00000020:00000080:1.0:1787906992.452689:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787906992.452695:0:12974:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787906992.452698:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cacfc5 00000020:00000080:1.0:1787906992.452701:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa53b109000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787906992.452711:0:12974:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa51a4db800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787906992.452714:0:12974:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa51a4db800 3 00000020:01000004:1.0:1787906992.452716:0:12974:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8aa51a4db800 from lustre-MDT0000 00000020:00000080:1.0:1787906992.452732:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787906992.452735:0:12974:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787906992.452737:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa53b0f0000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787906992.452740:0:12974:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53b0f0000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787906992.452751:0:12974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787906992.452810:0:12974:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1787906992.452835:0:12974:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787906992.452838:0:12974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787906992.452840:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787906992.452843:0:12974:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787906992.452850:0:12974:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8aa503138800 17707cff-d1ec-407e-b5de-6f2bf29614ad 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787906992.452856:0:12974:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8aa5073919b8) has exports, disconnecting them 00000020:00080000:1.0:1787906992.452860:0:12974:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8aa503138800), last request at 1787906725 00000020:00000080:1.0:1787906992.452873:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cacf63 00000020:00010000:1.0:1787906992.452877:0:12974:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8aa503138800: total 8 00000100:00080000:1.0:1787906992.452881:0:12974:0:(import.c:65:import_set_state_nolock()) ffff8aa503139800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787906992.452904:0:12974:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8aa503138800): rc 0 00000020:00080000:1.0:1787906992.452909:0:12974:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8aa5073919b8) has no exports 00000100:00100000:1.0:1787906992.453004:0:5823:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8aa507251a00:5823] 0 exiting: rc = 1 00000100:00100000:1.0:1787906992.453090:0:5824:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8aa507359200:5824] 1 exiting: rc = 0 00000100:00100000:0.0:1787906992.453858:0:11686:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8aa510a92a00:11686] 3 exiting: rc = 0 00000100:00100000:0.0:1787906992.453926:0:5825:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8aa507358200:5825] 2 exiting: rc = 0 00000020:00000080:2.0:1787906992.454185:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53b0f7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787906992.454208:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53b10f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1787906992.454213:0:37:0:(genops.c:885:class_export_put()) final put ffff8aa53b0f3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787906992.454216:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53b0f3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787906992.454220:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787906992.454348:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53b054800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787906992.454354:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa510320000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787906992.454359:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa510325800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787906992.454363:0:37:0:(genops.c:885:class_export_put()) final put ffff8aa510322000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787906992.454365:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa510322000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787906992.454369:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787906992.454430:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53f632800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787906992.454437:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa508a83800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787906992.454442:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa508a83000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787906992.454447:0:37:0:(genops.c:885:class_export_put()) final put ffff8aa53f8c0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787906992.454449:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53f8c0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787906992.454452:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787906992.454525:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53b108000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787906992.454529:0:37:0:(genops.c:885:class_export_put()) final put ffff8aa53b0f4800/lustre-MDD0000_UUID 00000020:00000080:2.0:1787906992.454531:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53b0f4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787906992.454534:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787906992.454695:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53b109000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1787906992.454993:0:8447:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8aa503138800: total 0 00010000:00010000:0.0:1787906992.455030:0:8447:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8aa503138800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787906992.455065:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511994a00/0x72bb6cf063cad28f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cad288 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906992.455087:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa541c97200/0x72bb6cf063cad4b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cad4b1 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906992.455120:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa508211200/0x72bb6cf063cad4c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cad4bf expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906992.455136:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511994400/0x72bb6cf063cad07b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cad074 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906992.455148:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa511994c00/0x72bb6cf063cad2b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cad2b2 expref: 5 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906992.455158:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa508211600/0x72bb6cf063cad265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cad25e expref: 4 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906992.455177:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cad273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cad26c expref: 3 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906992.455188:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa53ac8fa00/0x72bb6cf063cad281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bb6cf063cad27a expref: 2 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787906992.455208:0:8447:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8aa503138800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787906992.455221:0:8447:0:(genops.c:885:class_export_put()) final put ffff8aa503138800/17707cff-d1ec-407e-b5de-6f2bf29614ad 00010000:00010000:0.0:1787906992.455237:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906992.455239:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906992.455241:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787906992.455554:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa503138800/17707cff-d1ec-407e-b5de-6f2bf29614ad for MGS 00000020:00000080:2.0:1787906992.455600:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa503139800 for MGS 00000100:00100000:1.0:1787906992.457133:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457142:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457148:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457153:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457159:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457327:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457333:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457340:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457346:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457352:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457359:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457366:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457377:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457383:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457389:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457394:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457399:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457405:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457520:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457528:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457534:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457541:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457553:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457569:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457575:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457581:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457586:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457591:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457599:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457604:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457609:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457615:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457620:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457625:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457630:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457634:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457639:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457643:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457648:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457653:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457666:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457672:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457679:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457684:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457689:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457694:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457699:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457705:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457710:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457716:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457721:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457726:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457731:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457736:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457741:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457747:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457752:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457757:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457772:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457778:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457783:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457789:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457794:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.457800:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787906992.460688:0:12974:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787906992.460697:0:12974:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1787906992.469152:0:12974:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8aa401fddb40 - data ffff8aa51e29ca20/ffff8aa52ea31400 00000020:01000000:0.0:1787906992.469300:0:12974:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8aa504f1c0c0 - data ffff8aa5305e1ca8/ffff8aa5172d2000 00000020:00000080:0.0:1787906992.469872:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cacf47 00000020:00000080:0.0:1787906992.469881:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa511464000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787906992.469899:0:12974:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa51a4db800 from MGS, refs=2 00000020:01000004:0.0:1787906992.469903:0:12974:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa51a4db800 2 00000020:01000004:0.0:1787906992.469919:0:12974:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8aa51a4db800 from MGS 00000020:00000080:0.0:1787906992.469944:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787906992.469951:0:12974:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787906992.469954:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa511463000/MGS 00000020:00000080:0.0:1787906992.469957:0:12974:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa511463000/MGS for MGS 00000020:01000000:0.0:1787906992.469979:0:12974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787906992.470038:0:12974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787906992.470043:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787906992.470048:0:12974:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787906992.470056:0:12974:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8aa541c15000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787906992.470062:0:12974:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8aa5031199b8) has exports, disconnecting them 00000020:00080000:0.0:1787906992.470067:0:12974:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8aa541c15000), last request at 1787906726 00000020:00000080:0.0:1787906992.470072:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad012 00000020:00080000:0.0:1787906992.470081:0:12974:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8aa541c15000): rc 0 00000020:00000080:0.0:1787906992.470087:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa541c15000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787906992.470768:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa511464000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787906992.470780:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa541c15000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787906992.475909:0:12974:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787906992.475919:0:12974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787906992.475924:0:12974:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787906992.475934:0:12974:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787906992.476182:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787906992.476201:0:12974:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787906992.476211:0:12974:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa51a4db800 1 00000020:00000080:1.0:1787906992.476221:0:12974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cacf39 00000020:00000080:1.0:1787906992.476245:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa511461000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787906992.476252:0:12974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787906992.476258:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787906992.476264:0:12974:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787906992.476268:0:12974:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8aa510bd19b8) has no exports 00000020:00000080:2.0:1787906992.476656:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa520ac8800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787906992.476665:0:36:0:(genops.c:885:class_export_put()) final put ffff8aa52f19e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787906992.476668:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa52f19e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787906992.476681:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787906992.476749:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa511461000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787906992.541003:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787906992.541025:0:12974:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787906992.541032:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa509ede000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787906992.541038:0:12974:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa509ede000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787906992.541050:0:12974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787906992.546321:0:12974:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8aa509d26800 00000020:01000000:2.0:1787906992.546351:0:12974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787906992.546371:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787906992.546377:0:12974:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787906992.546382:0:12974:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8aa50311cd28) has no exports 00000100:00100000:2.0:1787906992.546495:0:5832:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8aa507251000:5832] 2 exiting: rc = 0 00000100:00100000:1.0:1787906992.547516:0:10853:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8aa5339fe200:10853] 3 exiting: rc = 0 00000100:00100000:1.0:1787906992.547612:0:5831:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8aa503046c00:5831] 1 exiting: rc = 0 00000100:00100000:3.0:1787906992.547974:0:5830:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8aa503047000:5830] 0 exiting: rc = 1 00000100:00100000:2.0:1787906992.548991:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549000:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549007:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549014:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549020:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549027:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549032:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549037:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549041:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549047:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549052:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549058:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549063:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549068:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549075:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549080:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549092:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549099:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549105:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549111:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549117:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549122:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549128:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549133:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549139:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549144:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549150:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549155:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549160:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549166:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549171:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549204:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549210:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549215:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549221:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549242:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549249:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549255:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549261:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549267:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549273:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549279:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549284:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549290:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549296:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549301:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549308:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549314:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549319:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549324:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549330:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549335:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549341:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549346:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549351:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549357:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549362:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549367:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549373:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549378:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549383:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549389:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549394:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.549408:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.554532:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8aa520a9a800:5833] 0 exiting: rc = 1 00000100:00100000:2.0:1787906992.555056:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8aa520a9b400:5834] 1 exiting: rc = 0 00000100:00100000:2.0:1787906992.555144:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555164:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555170:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555176:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555182:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555187:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555204:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555211:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555217:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555223:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555229:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555237:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555243:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555248:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555253:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555258:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555264:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555269:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555274:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555279:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555285:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555290:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555295:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555300:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555305:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555310:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555315:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555320:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555326:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555332:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555337:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555343:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555348:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555353:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555358:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555363:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555375:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555380:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555385:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555390:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555395:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555400:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555406:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555411:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555417:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555423:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555428:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555434:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555439:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555444:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555450:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555455:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555461:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555466:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555472:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555477:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555482:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555488:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555493:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555498:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555503:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555508:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555513:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.555518:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.556644:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8aa520a9a200:5836] 1 exiting: rc = 0 00000100:00100000:3.0:1787906992.557032:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8aa507358400:5835] 0 exiting: rc = 1 00000100:00100000:2.0:1787906992.557444:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557452:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557458:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557467:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557473:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557479:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557485:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557503:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557510:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557517:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557523:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557530:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557536:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557543:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557550:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557582:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557590:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557595:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557601:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557606:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557611:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557616:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557622:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557627:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557632:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557637:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557643:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557661:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557667:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557672:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557678:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557683:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557688:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557693:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557699:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557704:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557710:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557715:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557720:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557738:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557744:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557749:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557760:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557766:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557772:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557777:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557783:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557789:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557794:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557800:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557806:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557960:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557967:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557972:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557978:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557984:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557989:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.557995:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.558001:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.558007:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.558012:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.558017:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.558023:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.558037:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.575418:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8aa50314b200:5837] 0 exiting: rc = 1 00000100:00100000:0.0:1787906992.576061:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8aa520a9a400:5838] 1 exiting: rc = 0 00000100:00100000:2.0:1787906992.576306:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576314:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576320:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576325:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576330:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576336:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576342:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576348:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576353:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576359:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576364:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576369:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576374:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576392:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576397:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576402:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576421:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576426:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576431:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576436:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576441:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576446:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576451:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576457:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576461:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576465:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576469:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576474:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576478:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576484:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576489:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576493:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576497:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576502:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576507:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576512:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576516:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576521:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576526:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576530:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576536:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576540:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576545:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576549:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576553:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576570:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576575:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576579:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576592:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576596:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576602:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576607:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576613:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576617:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576622:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576627:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576633:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576638:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576643:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576649:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576653:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576657:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576662:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.576666:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.577158:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8aa50317e400:5840] 1 exiting: rc = 0 00000100:00100000:3.0:1787906992.577374:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8aa520a9aa00:5839] 0 exiting: rc = 1 00000100:00100000:2.0:1787906992.577496:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577504:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577510:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577515:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577520:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577525:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577530:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577536:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577542:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577548:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577565:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577571:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577577:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577583:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577588:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577594:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577599:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577605:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577611:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577627:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577632:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577637:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577642:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577648:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577653:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577659:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577664:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577669:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577674:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577679:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577684:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577689:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577694:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577699:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577705:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577710:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577715:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577721:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577726:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577731:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577736:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577741:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577747:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577752:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577757:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577762:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577767:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577772:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577777:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577783:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577789:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577794:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577799:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577804:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577844:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577849:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577854:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577859:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577865:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577870:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577875:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577880:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577884:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.577889:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.578470:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8aa50317e600:5842] 1 exiting: rc = 0 00000100:00100000:2.0:1787906992.578646:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8aa50314a000:5841] 0 exiting: rc = 1 00000100:00100000:2.0:1787906992.578697:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578703:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578708:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578713:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578718:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578724:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578729:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578735:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578740:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578745:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578749:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578755:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578759:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578764:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578768:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578773:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578778:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578782:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578787:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578796:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578806:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578843:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578849:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578854:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578870:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578876:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578882:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578887:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578893:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578899:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578905:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578911:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578917:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578922:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578928:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578935:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578941:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578947:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578952:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578958:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578964:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578969:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578974:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578980:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578985:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578991:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.578997:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579002:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579008:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579013:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579019:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579024:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579030:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579035:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579041:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579046:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579052:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579057:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579063:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579078:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579084:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579089:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579094:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.579099:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787906992.580048:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8aa520ac2a00:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1787906992.580290:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8aa520ac3800:5843] 0 exiting: rc = 1 00000100:00100000:0.0:1787906992.580637:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8aa50317f200:5845] 2 exiting: rc = 0 00000100:00100000:1.0:1787906992.580775:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580782:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580787:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580794:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580801:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580807:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580834:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580841:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580847:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580853:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580860:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580874:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580882:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580887:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580893:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580899:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580905:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580911:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580917:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580924:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580942:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580948:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580955:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580960:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580966:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580972:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580979:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580985:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580992:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.580998:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581005:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581011:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581016:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581022:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581029:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581050:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581057:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581064:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581069:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581075:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581081:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581086:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581093:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581099:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581104:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581109:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581115:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581122:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581127:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581133:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581139:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581145:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581151:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581157:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581162:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581174:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581180:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581185:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581333:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581344:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581352:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581359:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581367:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787906992.581383:0:12974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787906992.589114:0:12974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787906992.589129:0:12974:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787906992.589136:0:12974:0:(genops.c:885:class_export_put()) final put ffff8aa520acb000/MDS_uuid 00000020:00000080:2.0:1787906992.589140:0:12974:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa520acb000/MDS_uuid for MDS 00000020:01000000:2.0:1787906992.589147:0:12974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787906992.589301:0:12974:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787906992.805786:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906993.824947:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906994.851338:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787906995.873195:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787906996.147135:0:13123:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787906996.168152:0:13123:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787906996.168209:0:13123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906996.168225:0:13123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906996.168232:0:13123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906996.168239:0:13123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906996.168261:0:13123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787906996.168266:0:13123:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1787906996.168294:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787906996.168301:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906996.168309:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511995a00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787906996.168324:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906996.168334:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787906996.168341:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787906996.168346:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787906996.168348:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787906996.168350:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787906996.168401:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906996.168407:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787906996.168428:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906996.168434:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa511995a00/0x72bb6cf063cad27a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bb6cf063cad281 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787906996.168445:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906996.168446:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787906996.168447:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787906996.168466:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000376960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787906996.168555:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787906996.169943:0:13123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787906996.169951:0:13123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787906996.169960:0:13123:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787906996.169994:0:13123:0:(import.c:65:import_set_state_nolock()) ffff8aa40130d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787906996.170335:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000376960 00000100:00100000:3.0:1787906996.170348:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000376960 00000100:00100000:3.0:1787906996.172714:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787906996.172728:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3302:x1874756000376960:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787906996.172750:0:5815:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787906996 with bad export cookie 8267321320690863971 00000100:00100000:0.0:1787906996.175916:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1874756000377088:0@lo:39:umount.0 00000400:00000100:0.0:1787906996.175997:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874756000377088 offset 0 length 224: 4 00000100:00100000:2.0:1787906996.201884:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3302:x1874756000376960:12345-0@lo:103:ldlm_bl.0 Request processed in 29149us (33320us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787906996.201899:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787906996.202097:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787906996.202103:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8aa511460800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787906996.202107:0:3302:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787906996.221233:0:3302:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.120@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787906996.221240:0:3302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787906996.221251:0:3302:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8aa53f788000 x1874756000376960/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787907012 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787906996.221267:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787906996.221270:0:3302:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787906996.221271:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787906996.221279:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8aa511460800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787906996.221286:0:3302:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 163 00000100:00080000:3.0:1787906996.221293:0:3302:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff8aa511460800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1787906996.222290:0:3302:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa53495ce00 x1874756000377216/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787906996.222339:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17707cff-d1ec-407e-b5de-6f2bf29614ad:3302:1874756000376960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787906996.222715:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17707cff-d1ec-407e-b5de-6f2bf29614ad:3300:1874756000377216:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1787906996.222776:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874756000377216 offset 0 length 520: 4 00000100:00080000:1.0:1787906996.896101:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 17707cff-d1ec-407e-b5de-6f2bf29614ad->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787906996.896123:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 17707cff-d1ec-407e-b5de-6f2bf29614ad->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787906996.896196:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787906996.896221:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000377344:0@lo:400:kworker.0 00000400:00000100:1.0:1787906996.896287:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874756000377344 offset 0 length 224: 4 00010000:00010000:0.0:1787906996.910027:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787906996.978629:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787906996.978638:0:7636:0:(genops.c:885:class_export_put()) final put ffff8aa53b054000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787906996.978661:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53b054000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787906996.978701:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa53b057000 for lustre-OST0001 00000001:00100000:0.0:1787906996.989847:0:6699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787906996.989857:0:6699:0:(genops.c:885:class_export_put()) final put ffff8aa508a81000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787906996.990118:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa508a81000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787906996.990174:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa508a86000 for lustre-OST0000 00010000:00010000:1.0:1787906997.923024:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787906998.951201:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787906999.969006:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787907000.928463:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 17707cff-d1ec-407e-b5de-6f2bf29614ad->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787907000.928475:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 17707cff-d1ec-407e-b5de-6f2bf29614ad->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787907000.928631:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787907000.928657:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000377472:0@lo:400:kworker.0 00000400:00000100:2.0:1787907000.928719:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874756000377472 offset 0 length 224: 4 00010000:00010000:1.0:1787907000.992130:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907002.024115:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907003.040673:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907004.063939:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907005.088060:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787907006.113782:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 17707cff-d1ec-407e-b5de-6f2bf29614ad->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787907006.113791:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 17707cff-d1ec-407e-b5de-6f2bf29614ad->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787907006.114135:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787907006.114254:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874756000377600:0@lo:400:kworker.0 00000400:00000100:0.0:1787907006.114319:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874756000377600 offset 0 length 224: 4 00000100:00100000:0.0:1787907006.625312:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787906996/real 1787906996] req@ffff8aa53495ce00 x1874756000377216/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787907006 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907006.625351:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8aa53495ce00 x1874756000377216/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787907006 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907006.625363:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787906996/real 1787906996] req@ffff8aa53495c700 x1874756000377088/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787907006 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907006.625374:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8aa53495c700 x1874756000377088/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787907006 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787907006.625396:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa511460800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787907006.625427:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787907006.625431:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17707cff-d1ec-407e-b5de-6f2bf29614ad:3300:1874756000377216:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1787907006.625436:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa40130d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787907006.625454:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1874756000377088:0@lo:39:umount.0 00000100:00080000:3.0:1787907006.625591:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 17707cff-d1ec-407e-b5de-6f2bf29614ad->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787907006.625596:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787907006.625598:0:37:0:(import.c:65:import_set_state_nolock()) ffff8aa511460800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787907006.625604:0:37:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 434 00000100:00080000:3.0:1787907006.625608:0:37:0:(import.c:589:import_select_connection()) MGC192.168.204.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787907006.625615:0:37:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff8aa511460800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1787907006.625648:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa53f788380 x1874756000377728/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787907006.625912:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17707cff-d1ec-407e-b5de-6f2bf29614ad:3300:1874756000377728:0@lo:250:kworker.0 00000400:00000100:0.0:1787907006.625973:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874756000377728 offset 0 length 520: 4 00000100:00080000:2.0:1787907006.628193:0:13123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787907006.628202:0:13123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787907006.628210:0:13123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787907006.629501:0:13123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad28f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907006.629519:0:13123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad28f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907006.629527:0:13123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad28f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907006.629534:0:13123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad28f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907006.629552:0:13123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787907006.629559:0:13123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad4c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907006.629565:0:13123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad4c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907006.629572:0:13123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad4c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907006.629578:0:13123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad4c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907006.629622:0:13123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787907006.629627:0:13123:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787907006.629654:0:13123:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787907006.629659:0:13123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787907006.629664:0:13123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787907006.629669:0:13123:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787907006.629674:0:13123:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8aa50311b370) has no exports 00010000:00010000:1.0:1787907006.629856:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787907006.629863:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad28f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907006.629870:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210800 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:1.0:1787907006.629873:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad28f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907006.629881:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bb6cf063cad28f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787907006.629887:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bb6cf063cad28f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787907006.629899:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787907006.629901:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787907006.629903:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787907006.629921:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8aa511460800 00010000:00010000:1.0:1787907006.629924:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bb6cf063cad28f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907006.629942:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa508210800/0x72bb6cf063cad288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bb6cf063cad28f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907006.629955:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787907006.629958:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad4c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907006.629963:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96400 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:1.0:1787907006.629965:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad4c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907006.629970:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bb6cf063cad4c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787907006.629975:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bb6cf063cad4c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787907006.629980:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787907006.629982:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787907006.629984:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787907006.629988:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8aa511460800 00010000:00010000:1.0:1787907006.629991:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bb6cf063cad4c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907006.630004:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa541c96400/0x72bb6cf063cad4bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bb6cf063cad4c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907006.630013:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907006.630015:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907006.630016:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907006.631874:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787907006.632051:0:13123:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8aa50311b370) has no exports 00000020:01000000:3.0:1787907006.654278:0:13123:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8aa535eefae0 - data ffff8aa51e030870/ffff8aa53ac8bc00 00000020:01000000:3.0:1787907006.654472:0:13123:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8aa53b0a2300 - data ffff8aa51e302798/ffff8aa53f722000 00100000:10000000:3.0:1787907006.669886:0:13123:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787907006.707305:0:13123:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad097 00000020:00000080:0.0:1787907006.707315:0:13123:0:(genops.c:885:class_export_put()) final put ffff8aa53f8c2800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787907006.707338:0:13123:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa510341800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787907006.707342:0:13123:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa510341800 2 00000020:01000004:0.0:1787907006.707346:0:13123:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8aa510341800 from lustre-OST0000 00000020:00000080:0.0:1787907006.707382:0:13123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787907006.707391:0:13123:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787907006.707395:0:13123:0:(genops.c:885:class_export_put()) final put ffff8aa53f8c6800/lustre-OST0000_UUID 00000020:00000080:0.0:1787907006.707397:0:13123:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53f8c6800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787907006.707407:0:13123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787907006.707452:0:13123:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787907006.707456:0:13123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787907006.707459:0:13123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787907006.707464:0:13123:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787907006.707472:0:13123:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8aa53f8c4000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787907006.707479:0:13123:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8aa510bd3370) has exports, disconnecting them 00000020:00080000:0.0:1787907006.707484:0:13123:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8aa53f8c4000), last request at 1787906749 00000020:00000080:0.0:1787907006.707488:0:13123:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad0c1 00000020:00080000:0.0:1787907006.707497:0:13123:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8aa53f8c4000): rc 0 00000020:00000080:0.0:1787907006.707502:0:13123:0:(genops.c:885:class_export_put()) final put ffff8aa53f8c4000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787907006.707636:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53f8c2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787907006.707644:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53f8c4000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787907006.709895:0:13123:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787907006.709904:0:13123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787907006.709908:0:13123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787907006.709926:0:13123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787907006.710110:0:13123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787907006.710120:0:13123:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1787907006.710127:0:13123:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa510341800 1 00000020:00000080:1.0:1787907006.710133:0:13123:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad051 00000020:00000080:1.0:1787907006.710142:0:13123:0:(genops.c:885:class_export_put()) final put ffff8aa534b37000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787907006.710151:0:13123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787907006.710155:0:13123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787907006.710159:0:13123:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787907006.710162:0:13123:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8aa503118000) has no exports 00000020:00000080:3.0:1787907006.710407:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa40130d000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787907006.710415:0:37:0:(genops.c:885:class_export_put()) final put ffff8aa401308000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787907006.710418:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa401308000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787907006.710424:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787907006.710476:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa534b37000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787907006.724256:0:13123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787907006.724274:0:13123:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787907006.724291:0:13123:0:(genops.c:885:class_export_put()) final put ffff8aa510347000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787907006.724297:0:13123:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa510347000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787907006.724306:0:13123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787907006.724467:0:13123:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8aa510343800 00000020:02000400:3.0:1787907006.724531:0:13123:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787907007.136125:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907008.161662:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907009.195473:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787907009.747909:0:13278:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787907009.761152:0:13278:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787907009.761243:0:13278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad265 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907009.761257:0:13278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad265 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907009.761265:0:13278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad265 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907009.761271:0:13278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad265 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907009.761298:0:13278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787907009.761318:0:13278:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787907009.761351:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787907009.761365:0:13278:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8aa4037a6300 x1874756000377344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907012 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907009.761384:0:13278:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8aa53f788700 x1874756000377472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907016 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907009.761409:0:13278:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8aa53f789c00 x1874756000377600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907022 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907009.761424:0:13278:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1787907009.761461:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874756000377600:0@lo:400:kworker.0 00000100:00080000:0.0:1787907009.761496:0:13278:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787907009.761519:0:13278:0:(import.c:65:import_set_state_nolock()) ffff8aa53b056800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787907009.761552:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1874756000377856:0@lo:39:umount.0 00000400:00000100:0.0:1787907009.761615:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874756000377856 offset 0 length 224: 4 00010000:00010000:3.0:1787907009.761725:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907009.761733:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad265 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907009.761737:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000377472:0@lo:400:kworker.0 00010000:00010000:3.0:1787907009.761742:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97e00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787907009.761746:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad265 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907009.761766:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bb6cf063cad265 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787907009.761773:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bb6cf063cad265 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787907009.761779:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787907009.761782:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787907009.761785:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787907009.761800:0:8447:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8aa511460800 00010000:00010000:3.0:1787907009.761804:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bb6cf063cad265 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907009.761861:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa541c97e00/0x72bb6cf063cad25e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bb6cf063cad265 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907009.761872:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907009.761874:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907009.761876:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787907009.761996:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000377344:0@lo:400:kworker.0 00010000:00010000:3.0:1787907010.208694:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907011.243668:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787907011.744134:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 17707cff-d1ec-407e-b5de-6f2bf29614ad->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787907011.744147:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 17707cff-d1ec-407e-b5de-6f2bf29614ad->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787907012.255999:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907013.280836:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907014.304005:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907015.327980:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907016.352031:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787907016.864452:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 17707cff-d1ec-407e-b5de-6f2bf29614ad->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787907016.864465:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 17707cff-d1ec-407e-b5de-6f2bf29614ad->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787907017.376269:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907018.400173:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907019.424194:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787907019.999959:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787907009/real 1787907009] req@ffff8aa535e8b800 x1874756000377856/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787907019 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907019.999993:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8aa535e8b800 x1874756000377856/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787907019 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787907020.000011:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa53b056800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787907020.000096:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1874756000377856:0@lo:39:umount.0 00000100:00080000:1.0:1787907020.000699:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787907020.000705:0:13278:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787907020.000710:0:13278:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787907020.003318:0:13278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907020.003338:0:13278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907020.003346:0:13278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907020.003352:0:13278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907020.003379:0:13278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787907020.003386:0:13278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cad4b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907020.003392:0:13278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cad4b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907020.003398:0:13278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad4b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907020.003403:0:13278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bb6cf063cad4b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907020.003421:0:13278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787907020.003426:0:13278:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787907020.003465:0:13278:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787907020.003469:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787907020.003474:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787907020.003481:0:13278:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787907020.003485:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8aa507393370) has no exports 00000020:00080000:1.0:1787907020.003514:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8aa507393370) has no exports 00010000:00010000:3.0:1787907020.003648:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787907020.003656:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907020.003665:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511995200 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787907020.003669:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907020.003685:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bb6cf063cad273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787907020.003692:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bb6cf063cad273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787907020.003698:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787907020.003700:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787907020.003703:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787907020.003717:0:8447:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8aa511460800 00010000:00010000:3.0:1787907020.003721:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bb6cf063cad273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907020.003728:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa511995200/0x72bb6cf063cad26c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bb6cf063cad273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907020.003741:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907020.003745:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad4b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907020.003762:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031600 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787907020.003765:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bb6cf063cad4b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907020.003772:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bb6cf063cad4b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787907020.003778:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bb6cf063cad4b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787907020.003793:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787907020.003795:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787907020.003797:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787907020.003803:0:8447:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8aa511460800 00010000:00010000:3.0:1787907020.003806:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bb6cf063cad4b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907020.003860:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cad4b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bb6cf063cad4b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907020.003875:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907020.003876:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907020.003879:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907020.004117:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787907020.011497:0:13278:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8aa535eef720 - data ffff8aa51e3ed948/ffff8aa510234400 00000020:01000000:1.0:1787907020.011652:0:13278:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8aa50f0b04e0 - data ffff8aa530736000/ffff8aa53b04d400 00100000:10000000:1.0:1787907020.022632:0:13278:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787907020.058605:0:13278:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad162 00000020:00000080:3.0:1787907020.058615:0:13278:0:(genops.c:885:class_export_put()) final put ffff8aa534cae000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787907020.058628:0:13278:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa401350800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787907020.058632:0:13278:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa401350800 2 00000020:01000004:3.0:1787907020.058635:0:13278:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8aa401350800 from lustre-OST0001 00000020:00000080:3.0:1787907020.058659:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787907020.058670:0:13278:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787907020.058674:0:13278:0:(genops.c:885:class_export_put()) final put ffff8aa534cab800/lustre-OST0001_UUID 00000020:00000080:3.0:1787907020.058677:0:13278:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa534cab800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787907020.058684:0:13278:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787907020.058786:0:13278:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 17707cff-d1ec-407e-b5de-6f2bf29614ad->MGS 00010000:00010000:3.0:1787907020.058801:0:13278:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa5421fba00/0x72bb6cf063cad074 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bb6cf063cad07b expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787907020.058859:0:13278:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa5421fba00/0x72bb6cf063cad074 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bb6cf063cad07b expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787907020.058881:0:13278:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787907020.058884:0:13278:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787907020.058888:0:13278:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787907020.058904:0:13278:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8aa511460800 00010000:00010000:3.0:1787907020.058908:0:13278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa5421fba00/0x72bb6cf063cad074 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bb6cf063cad07b expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907020.058924:0:13278:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8f000/0x72bb6cf063cad2b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bb6cf063cad2b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787907020.058931:0:13278:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8f000/0x72bb6cf063cad2b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bb6cf063cad2b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787907020.058937:0:13278:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787907020.058940:0:13278:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787907020.058942:0:13278:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787907020.058959:0:13278:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8aa511460800 00010000:00010000:3.0:1787907020.058962:0:13278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8f000/0x72bb6cf063cad2b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bb6cf063cad2b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787907020.058981:0:13278:0:(import.c:65:import_set_state_nolock()) ffff8aa511460800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787907020.058985:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787907020.058988:0:13278:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787907020.058989:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787907020.058993:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787907020.059004:0:13278:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8aa53f788380 x1874756000377728/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787907021 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787907020.059033:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787907020.059036:0:13278:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000020:00000080:2.0:1787907020.059188:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa534cae000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1787907020.062106:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17707cff-d1ec-407e-b5de-6f2bf29614ad:3300:1874756000377728:0@lo:250:kworker.0 10000000:01000000:3.0:1787907020.062937:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787907020.062974:0:13278:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cacf55 00000020:00000080:3.0:1787907020.062988:0:13278:0:(genops.c:885:class_export_put()) final put ffff8aa520acb800/17707cff-d1ec-407e-b5de-6f2bf29614ad 00000020:01000000:3.0:1787907020.063003:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.120@tcp (flags='') 00000020:00000080:3.0:1787907020.063010:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787907020.063019:0:13278:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.120@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787907020.063033:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8aa510bd0000) has no exports 10000000:01000000:1.0:1787907020.063109:0:5827:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1787907020.063264:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa520acb800/17707cff-d1ec-407e-b5de-6f2bf29614ad for MGC192.168.204.120@tcp 10000000:01000000:3.0:1787907020.063318:0:13278:0:(obd_class.h:673:obd_cleanup_client_import()) MGC192.168.204.120@tcp: client import never connected 00000100:00080000:3.0:1787907020.063323:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787907020.063326:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787907020.063329:0:13278:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787907020.063331:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787907020.063379:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787907020.063385:0:13278:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.120@tcp (uuid 17707cff-d1ec-407e-b5de-6f2bf29614ad) 00000020:01000000:3.0:1787907020.063391:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787907020.063394:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787907020.063398:0:13278:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787907020.063404:0:13278:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8aa53b053000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787907020.063409:0:13278:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8aa52ebc0000) has exports, disconnecting them 00000020:00080000:3.0:1787907020.063414:0:13278:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8aa53b053000), last request at 1787906772 00000020:00000080:3.0:1787907020.063417:0:13278:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad18c 00000020:00080000:3.0:1787907020.063429:0:13278:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8aa53b053000): rc 0 00000020:00000080:3.0:1787907020.063433:0:13278:0:(genops.c:885:class_export_put()) final put ffff8aa53b053000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787907020.063600:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa511460800 for MGC192.168.204.120@tcp 00000020:00000080:2.0:1787907020.063607:0:36:0:(genops.c:885:class_export_put()) final put ffff8aa507363000/17707cff-d1ec-407e-b5de-6f2bf29614ad 00000020:00000080:2.0:1787907020.063610:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa507363000/17707cff-d1ec-407e-b5de-6f2bf29614ad for MGC192.168.204.120@tcp 00000020:01000000:2.0:1787907020.063616:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.120@tcp (17707cff-d1ec-407e-b5de-6f2bf29614ad) 00000020:00000080:2.0:1787907020.064569:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa53b053000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787907020.066517:0:13278:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787907020.066526:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787907020.066531:0:13278:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787907020.066540:0:13278:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787907020.066744:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1787907020.066917:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8aa53b056800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1787907020.066992:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787907020.069887:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787907020.070218:0:6688:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8aa51ecc1c00:6688] 2 exiting: rc = 0 00000100:00100000:1.0:1787907020.070323:0:5814:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8aa5102ae200:5814] 1 exiting: rc = 0 00000100:00100000:0.0:1787907020.073903:0:5813:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8aa5102af200:5813] 0 exiting: rc = 1 00000100:00100000:2.0:1787907020.074003:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.074323:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8aa517233600:5817] 2 exiting: rc = 0 00000100:00100000:2.0:1787907020.074379:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8aa5102c0c00:5815] 0 exiting: rc = 1 00000100:00100000:2.0:1787907020.074454:0:8506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8aa5102afa00:8506] 3 exiting: rc = 0 00000100:00100000:1.0:1787907020.075866:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8aa5102c0400:5816] 1 exiting: rc = 0 00000100:00100000:2.0:1787907020.078059:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078070:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078076:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078082:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078090:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078096:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078102:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078109:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078114:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078120:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078133:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078141:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078147:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078153:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078159:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078166:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078172:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078177:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078182:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078188:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078194:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078199:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078205:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078211:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078216:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078221:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078227:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078232:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078238:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078244:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078250:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078256:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078262:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078267:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078293:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078299:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078306:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078313:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078319:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078327:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078335:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078341:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078346:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078352:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078358:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078364:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078369:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078375:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078381:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078387:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078392:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078398:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078403:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078409:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078416:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078421:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078428:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078434:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078440:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078445:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078451:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078458:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078464:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.078473:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787907020.080160:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787907020.080173:0:13278:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787907020.080179:0:13278:0:(genops.c:885:class_export_put()) final put ffff8aa507d69000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787907020.080184:0:13278:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa507d69000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787907020.080189:0:13278:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1787907020.080240:0:13278:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa401350800 1 00000020:00000080:1.0:1787907020.080245:0:13278:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bb6cf063cad131 00000020:00000080:1.0:1787907020.080252:0:13278:0:(genops.c:885:class_export_put()) final put ffff8aa507d6b800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787907020.080263:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787907020.080276:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa507d6b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787907020.080288:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787907020.080292:0:13278:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787907020.080296:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8aa507390000) has no exports 00000020:00000080:1.0:1787907020.142398:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787907020.142414:0:13278:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787907020.142421:0:13278:0:(genops.c:885:class_export_put()) final put ffff8aa401357000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787907020.142427:0:13278:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa401357000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787907020.142439:0:13278:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787907020.145766:0:13278:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8aa401352800 00000020:01000000:1.0:1787907020.145800:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787907020.145831:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787907020.145839:0:13278:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787907020.145844:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8aa52ebc19b8) has no exports 00000020:00000080:1.0:1787907020.145877:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787907020.145885:0:13278:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787907020.145890:0:13278:0:(genops.c:885:class_export_put()) final put ffff8aa534b31000/OSS_uuid 00000020:00000080:1.0:1787907020.145894:0:13278:0:(genops.c:844:class_export_destroy()) destroying export ffff8aa534b31000/OSS_uuid for OSS 00000020:01000000:1.0:1787907020.145904:0:13278:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1787907020.146105:0:8459:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8aa401894a00:8459] 3 exiting: rc = 0 00000100:00100000:3.0:1787907020.146211:0:6674:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8aa52ebc9800:6674] 1 exiting: rc = 0 00000100:00100000:0.0:1787907020.148318:0:6673:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8aa52ebc8400:6673] 0 exiting: rc = 1 00000100:00080000:2.0:1787907020.152200:0:5826:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787907020.152629:0:6675:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8aa52ebc8a00:6675] 2 exiting: rc = 0 00000100:00100000:2.0:1787907020.154416:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154428:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154435:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154456:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154461:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154466:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154471:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154475:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154481:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154486:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154491:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154497:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154502:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154508:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154513:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154519:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154524:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154530:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154534:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154539:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154544:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154550:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154555:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154560:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154564:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154569:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154574:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154579:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154584:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154589:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154594:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154600:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154605:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154614:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154619:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154625:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154631:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154639:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154652:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154669:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154675:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154681:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154687:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154692:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154698:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154703:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154709:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154714:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154720:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154724:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154728:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154736:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154742:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154749:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154758:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154763:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154769:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154773:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154778:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154782:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154787:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154792:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154802:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.154807:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.157390:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8aa510aca000:6677] 1 exiting: rc = 0 00000100:00100000:1.0:1787907020.157766:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8aa510acae00:6676] 0 exiting: rc = 1 00000100:00100000:2.0:1787907020.157940:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.157949:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.157954:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.157959:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.157963:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.157968:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.157973:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.157978:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158000:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158007:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158013:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158043:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158049:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158156:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158163:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158168:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158174:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158180:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158191:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158196:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158201:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158207:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158212:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158217:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158223:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158230:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158235:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158240:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158245:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158250:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158257:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158262:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158267:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158277:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158283:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158290:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158296:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158301:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158307:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158313:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158320:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158325:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158331:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.158346:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159387:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159402:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159408:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159414:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159420:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159425:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159432:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159437:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159443:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159448:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159454:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159459:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159465:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159471:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159478:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159484:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159489:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159495:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159501:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.159507:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.161181:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8aa52ebc9400:6678] 0 exiting: rc = 1 00000100:00100000:2.0:1787907020.161471:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8aa52ebb2a00:6679] 1 exiting: rc = 0 00000100:00100000:2.0:1787907020.165257:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8aa52ebb2800:6680] 2 exiting: rc = 0 00000100:00100000:2.0:1787907020.165464:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165473:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165480:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165486:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165492:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165498:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165504:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165510:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165523:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165532:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165560:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165565:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165571:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165576:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165582:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165587:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165593:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165599:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165619:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165636:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165642:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165652:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165669:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165676:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165681:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165688:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165694:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165699:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165705:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165710:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165716:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165721:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165727:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165733:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165739:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165745:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165751:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165757:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165762:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165768:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165774:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165779:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165833:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165841:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165848:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165861:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165867:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165873:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165879:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165891:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165898:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165904:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165925:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165933:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165939:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165944:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165950:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165956:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165961:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165966:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165971:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165977:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165983:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.165989:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.173939:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8aa52ebc9a00:6682] 1 exiting: rc = 0 00000100:00100000:3.0:1787907020.174234:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8aa52ebc8000:6681] 0 exiting: rc = 1 00000100:00100000:2.0:1787907020.174395:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174406:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174412:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174417:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174561:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174570:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174576:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174580:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174586:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174590:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174595:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174600:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174605:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174611:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174616:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174663:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174670:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174676:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174682:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174687:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174693:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174698:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174704:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174709:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174714:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174719:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174724:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174729:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174735:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174740:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174746:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174752:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174758:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174763:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174768:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174773:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174780:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174786:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174791:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174796:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174800:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174835:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174844:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174850:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174855:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174864:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174869:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174875:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174880:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174885:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174903:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174909:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174915:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174921:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174927:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174932:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174937:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174943:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174954:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174960:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174966:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174972:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174977:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.174983:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176306:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8aa536d8ca00:6684] 1 exiting: rc = 0 00000100:00100000:1.0:1787907020.176615:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8aa536d8d800:6683] 0 exiting: rc = 1 00000100:00100000:2.0:1787907020.176792:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176804:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176845:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176853:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176863:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176870:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176885:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176891:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176917:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176925:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176937:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176945:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176950:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176957:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176963:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176969:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176975:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176984:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176989:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.176996:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177122:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177132:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177138:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177143:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177149:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177154:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177160:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177166:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177171:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177178:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177184:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177190:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177209:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177215:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177221:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177228:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177235:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177241:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177246:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177252:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177258:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177264:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177270:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177276:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177296:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177304:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177309:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177316:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177322:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177328:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177334:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177340:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177381:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177387:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177397:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177411:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177430:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177443:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177450:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177455:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177461:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177470:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177476:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787907020.177483:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787907020.193286:0:13278:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787907040.758075:0:13898:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787907050.868442:0:14359:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787907050.868446:0:14359:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787907050.868567:0:14359:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8aa52f19c000 00000020:01000004:1.0:1787907050.868588:0:14359:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787907050.868597:0:14359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787907050.868613:0:14359:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8aa5187cb370) 00000020:00000080:1.0:1787907050.869225:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787907050.892943:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787907050.895261:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787907050.895717:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787907050.895787:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 457: rc = 0 00100000:10000000:2.0:1787907050.896112:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 457: rc = 0 00100000:10000000:2.0:1787907050.896210:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 457: rc = 0 00100000:10000000:2.0:1787907050.896300:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 457: rc = 0 00100000:10000000:2.0:1787907050.896395:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 457: rc = 0 00100000:10000000:2.0:1787907050.896511:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 457: rc = 0 00100000:10000000:2.0:1787907050.896777:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 98: rc = 0 00100000:10000000:2.0:1787907050.897951:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 379: rc = 0 00100000:10000000:2.0:1787907050.898137:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 379: rc = 0 00100000:10000000:2.0:1787907050.898630:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 541: rc = 0 00100000:10000000:2.0:1787907050.898912:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 541: rc = 0 00100000:10000000:2.0:1787907050.899237:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 541: rc = 0 00100000:10000000:2.0:1787907050.899509:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 541: rc = 0 00100000:10000000:2.0:1787907050.899772:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 541: rc = 0 00100000:10000000:2.0:1787907050.900212:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 541: rc = 0 00100000:10000000:2.0:1787907050.900487:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 541: rc = 0 00100000:10000000:2.0:1787907050.900737:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 541: rc = 0 00100000:10000000:2.0:1787907050.901009:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 541: rc = 0 00100000:10000000:2.0:1787907050.901345:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 541: rc = 0 00100000:10000000:2.0:1787907050.901619:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 541: rc = 0 00100000:10000000:2.0:1787907050.902103:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 541: rc = 0 00100000:10000000:2.0:1787907050.902558:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 557: rc = 0 00100000:10000000:2.0:1787907050.902798:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 557: rc = 0 00100000:10000000:2.0:1787907050.903391:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 557: rc = 0 00100000:10000000:2.0:1787907050.903676:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 557: rc = 0 00100000:10000000:2.0:1787907050.904188:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 557: rc = 0 00100000:10000000:2.0:1787907050.904435:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 557: rc = 0 00100000:10000000:2.0:1787907050.904698:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 557: rc = 0 00100000:10000000:2.0:1787907050.904966:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 557: rc = 0 00100000:10000000:2.0:1787907050.905289:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 557: rc = 0 00100000:10000000:2.0:1787907050.905560:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 557: rc = 0 00100000:10000000:2.0:1787907050.905919:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 557: rc = 0 00100000:10000000:2.0:1787907050.906262:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 557: rc = 0 00100000:10000000:2.0:1787907050.906506:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 557: rc = 0 00100000:10000000:2.0:1787907050.907122:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 557: rc = 0 00100000:10000000:2.0:1787907050.908596:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 557: rc = 0 00100000:10000000:2.0:1787907050.908881:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 557: rc = 0 00100000:10000000:2.0:1787907050.909362:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 557: rc = 0 00100000:10000000:2.0:1787907050.909673:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 557: rc = 0 00100000:10000000:2.0:1787907050.910156:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 557: rc = 0 00100000:10000000:2.0:1787907050.910415:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 557: rc = 0 00100000:10000000:2.0:1787907050.910667:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 557: rc = 0 00100000:10000000:2.0:1787907050.910952:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 557: rc = 0 00100000:10000000:2.0:1787907050.911277:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 557: rc = 0 00100000:10000000:2.0:1787907050.911537:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 557: rc = 0 00100000:10000000:2.0:1787907050.912193:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 557: rc = 0 00100000:10000000:2.0:1787907050.912566:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 557: rc = 0 00100000:10000000:2.0:1787907050.912866:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 557: rc = 0 00100000:10000000:2.0:1787907050.913131:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 557: rc = 0 00100000:10000000:2.0:1787907050.913389:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 557: rc = 0 00100000:10000000:2.0:1787907050.913663:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 557: rc = 0 00100000:10000000:2.0:1787907050.914195:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 557: rc = 0 00100000:10000000:2.0:1787907050.914444:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 557: rc = 0 00100000:10000000:2.0:1787907050.914783:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 770: rc = 0 00100000:10000000:2.0:1787907050.915400:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787907050.915569:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 380: rc = 0 00100000:10000000:2.0:1787907050.915764:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787907050.916335:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 380: rc = 0 00100000:10000000:3.0:1787907050.916561:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787907050.916633:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 380: rc = 0 00100000:10000000:3.0:1787907050.917004:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787907050.917171:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 383: rc = 0 00100000:10000000:3.0:1787907050.917382:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787907050.917469:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 383: rc = 0 00100000:10000000:3.0:1787907050.917679:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787907050.917748:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 383: rc = 0 00000020:00000080:3.0:1787907050.918304:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787907050.918314:0:14359:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787907050.918327:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bb6cf063cae256 00000020:01000004:3.0:1787907050.918339:0:14359:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787907050.918344:0:14359:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787907050.918350:0:14359:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8aa52f19c000 from MGS 00000020:01000004:3.0:1787907050.918354:0:14359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787907050.918368:0:14359:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8aa507393370) 00000020:00000080:3.0:1787907050.918379:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787907050.918458:0:14359:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa52f19c000 from MGS, refs=2 00080000:01000000:3.0:1787907050.918463:0:14359:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787907050.918468:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bb6cf063cae264 00000100:00100000:3.0:1787907050.918580:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787907050.918736:0:14359:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787907050.918743:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787907050.919650:0:14359:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787907050.919661:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787907050.920549:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787907050.920972:0:14359:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787907050.920985:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787907050.921523:0:14359:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787907050.921529:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787907050.921970:0:14359:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787907050.921976:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787907050.922642:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907050.922646:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907050.922647:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907050.923143:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907050.923145:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907050.923147:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907050.923683:0:14359:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787907050.926235:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787907050.936191:0:14359:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787907050.936211:0:14359:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787907050.936214:0:14359:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787907050.937755:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787907050.937927:0:14359:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787907050.938097:0:14359:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787907050.938611:0:14359:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787907050.938954:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787907050.939491:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787907050.939498:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787907050.946043:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787907050.946060:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787907050.946857:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787907050.946866:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787907050.949574:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787907050.949599:0:14359:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.120@tcp' 00000020:01000004:1.0:1787907050.949600:0:14359:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787907050.949630:0:14359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.120@tcp (typ=mgc) 00000020:00000080:1.0:1787907050.949649:0:14359:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.120@tcp (ffff8aa5187ccd28) 00000020:00000080:1.0:1787907050.949664:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787907050.949741:0:14359:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa507364800@MGC192.168.204.120@tcp: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1787907050.949927:0:14359:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.120@tcp-0 is initialized 00000040:01000000:1.0:1787907050.949933:0:14359:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787907050.950139:0:14373:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787907050.954238:0:14374:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787907050.955359:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.120@tcp (uuid ebba1202-2d0e-4d1e-8963-43f853425a20) 00000020:00000080:1.0:1787907050.955388:0:14359:0:(genops.c:1385:class_connect()) connect: client ebba1202-2d0e-4d1e-8963-43f853425a20, cookie 0x72bb6cf063cae272 00000100:00080000:1.0:1787907050.955402:0:14359:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787907050.955409:0:14359:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff8aa507364800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1787907050.955455:0:14359:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa4037a6a00 x1874756000377984/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787907050.955484:0:14359:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ebba1202-2d0e-4d1e-8963-43f853425a20->MGS 00000020:01000004:1.0:1787907050.955502:0:14359:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787907050.955508:0:14359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787907050.955522:0:14359:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8aa5187c99b8) 00000020:00000080:1.0:1787907050.955535:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787907050.957163:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebba1202-2d0e-4d1e-8963-43f853425a20:3300:1874756000377984:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787907050.957240:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907050.957337:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000377984 00000100:00100000:0.0:1787907050.957345:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000377984 00000100:00100000:0.0:1787907050.957377:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787907050.957384:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3300:x1874756000377984:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787907050.957409:0:14369:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ebba1202-2d0e-4d1e-8963-43f853425a20@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:0.0:1787907050.957446:0:14369:0:(genops.c:1385:class_connect()) connect: client ebba1202-2d0e-4d1e-8963-43f853425a20, cookie 0x72bb6cf063cae280 00000100:00080000:0.0:1787907050.957573:0:14369:0:(import.c:65:import_set_state_nolock()) ffff8aa507d6a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787907050.957620:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+5:3300:x1874756000377984:12345-0@lo:250:mount.lustre.0 Request processed in 234us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907050.957627:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787907050.957669:0:3300:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787907050.957676:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.120@tcp: connect to target with instance 0 00000100:00080000:0.0:1787907050.957684:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787907050.957688:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787907050.957692:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa507364800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787907050.957694:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787907050.957703:0:3300:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787907050.957708:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebba1202-2d0e-4d1e-8963-43f853425a20:3300:1874756000377984:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787907050.977560:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787907050.977775:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787907050.977781:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787907050.979789:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787907050.979800:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787907050.980585:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787907050.980593:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787907050.981573:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787907050.981797:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787907050.981804:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787907050.982434:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787907050.982441:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787907051.026346:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787907051.026592:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787907051.026600:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787907051.028022:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787907051.028035:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787907051.028629:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787907051.028887:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787907051.028893:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787907051.029398:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787907051.029405:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787907051.030239:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787907051.030404:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787907051.030410:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787907051.031415:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787907051.031432:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787907051.032468:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787907051.032634:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787907051.032640:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787907051.033312:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787907051.033320:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787907051.065201:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787907051.065500:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787907051.065508:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787907051.080343:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787907051.080378:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787907051.081945:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787907051.081958:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787907051.086170:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787907051.086195:0:14359:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787907051.086202:0:14359:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787907051.086342:0:14359:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787907051.086390:0:14359:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787907051.086395:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787907051.086397:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787907051.086398:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787907051.086399:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787907051.086400:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787907051.086401:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787907051.086402:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787907051.086404:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787907051.086406:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787907051.086407:0:14359:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787907051.086410:0:14359:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787907051.086412:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787907051.086413:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787907051.086414:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787907051.086415:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787907051.086416:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787907051.086417:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787907051.086418:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787907051.086419:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787907051.086420:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787907051.086431:0:14359:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787907051.086457:0:14359:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787907051.086476:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000378112:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787907051.086546:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907051.086603:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5186143c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787907051.086986:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000378112 00000100:00100000:3.0:1787907051.086994:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000378112 00000100:00100000:3.0:1787907051.087049:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787907051.087059:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+5:14359:x1874756000378112:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787907051.087109:0:14372:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787907051.087113:0:14372:0:(mgs_handler.c:480:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787907051.087266:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787907051.087670:0:14372:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787907051.102996:0:14394:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787907051.103006:0:14394:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787907051.103751:0:14394:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787907051.103917:0:14394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787907051.106352:0:14372:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787907051.106364:0:14372:0:(mgs_handler.c:538:mgs_target_reg()) Checking nodemap for target registration lustre-MDT0000 20000000:01000000:1.0:1787907051.106368:0:14372:0:(mgs_handler.c:544:mgs_target_reg()) lustre-MDT0000: Nodemap subsystem disabled, allowing target registration 20000000:01000000:1.0:1787907051.106375:0:14372:0:(mgs_handler.c:567:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:1.0:1787907051.106385:0:14372:0:(mgs_handler.c:675:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787907051.128598:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+5:14359:x1874756000378112:12345-0@lo:253:mount.lustre.0 Request processed in 41526us (42037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907051.128629:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787907051.128870:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000378112:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787907051.128886:0:14359:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787907051.128890:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787907051.128892:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787907051.128894:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787907051.128895:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787907051.128896:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787907051.128897:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787907051.128898:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787907051.128900:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787907051.128902:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787907051.128904:0:14359:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787907051.128924:0:14359:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8aa52f19c000 from lustre-MDT0000 10000000:01000000:0.0:1787907051.128947:0:14359:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787907051.128949:0:14359:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787907051.128954:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8aa5187ccd28 10000000:01000000:0.0:1787907051.128958:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787907051.128967:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8aa5187ccd28 from 1 10000000:01000000:0.0:1787907051.128970:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787907051.129250:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e800/0x72bb6cf063cae287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.129262:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e800/0x72bb6cf063cae287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.129273:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e800/0x72bb6cf063cae287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907051.132466:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000378240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787907051.132581:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907051.132681:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa51860b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787907051.133177:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000378240 00000100:00100000:0.0:1787907051.133186:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000378240 00000100:00100000:0.0:1787907051.133313:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787907051.133324:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+5:14359:x1874756000378240:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787907051.133343:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907051.133383:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa53ac8f000/0x72bb6cf063cae28e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae287 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.133416:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa53ac8f000/0x72bb6cf063cae28e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae287 expref: 6 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.133439:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa53ac8f000/0x72bb6cf063cae28e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae287 expref: 6 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.133449:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f000, rc 0) 00000100:00100000:0.0:1787907051.133508:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+6:14359:x1874756000378240:12345-0@lo:101:mount.lustre.0 Request processed in 185us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907051.133515:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787907051.133600:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000378240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787907051.133629:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e800/0x72bb6cf063cae287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae28e expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.133640:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e800/0x72bb6cf063cae287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae28e expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907051.133724:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000378368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787907051.133752:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907051.134277:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa51860b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787907051.134464:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000378368 00000100:00100000:2.0:1787907051.134471:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000378368 00000100:00100000:2.0:1787907051.134502:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787907051.134510:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+6:14359:x1874756000378368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787907051.134934:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+6:14359:x1874756000378368:12345-0@lo:501:mount.lustre.0 Request processed in 424us (1179us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787907051.134942:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787907051.135242:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000378368:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787907051.135274:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787907051.135333:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e800/0x72bb6cf063cae287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae28e expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.135343:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e800/0x72bb6cf063cae287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae28e expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787907051.135415:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8aa52f19c000 10000000:01000000:1.0:1787907051.135430:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787907051.135435:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8aa52f19c000 10000000:01000000:1.0:1787907051.135438:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787907051.135441:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8aa52f19c000 from 1 10000000:01000000:1.0:1787907051.135444:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787907051.135475:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cae295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.135490:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cae295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.135499:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cae295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907051.135515:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000378496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787907051.135549:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907051.135582:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa51860b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787907051.135650:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000378496 00000100:00100000:2.0:1787907051.135656:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000378496 00000100:00100000:1.0:1787907051.135856:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787907051.135866:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+6:14359:x1874756000378496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787907051.135877:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907051.135890:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa508211400/0x72bb6cf063cae29c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae295 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.135910:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508211400/0x72bb6cf063cae29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae295 expref: 7 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.135920:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa508211400/0x72bb6cf063cae29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae295 expref: 7 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.135930:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211400, rc 0) 00000100:00100000:1.0:1787907051.135979:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+7:14359:x1874756000378496:12345-0@lo:101:mount.lustre.0 Request processed in 114us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907051.135986:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787907051.136208:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000378496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787907051.136222:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cae295 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae29c expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907051.136230:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cae295 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae29c expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787907051.136243:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787907051.136610:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cae295 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae29c expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907051.136632:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa508211c00/0x72bb6cf063cae295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae29c expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787907051.136652:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787907051.136657:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787907051.136663:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8aa52f19c000 10000000:01000000:3.0:1787907051.136665:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787907051.136669:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787907051.136671:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787907051.136981:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cae2a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907051.136990:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cae2a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907051.137000:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cae2a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907051.137029:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f788a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000378624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787907051.137083:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907051.137111:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa506992900 going to sleep for 11 seconds 00000100:00100000:1.0:1787907051.137290:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000378624 00000100:00100000:1.0:1787907051.137298:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000378624 00000100:00100000:2.0:1787907051.137456:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787907051.137468:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+7:14359:x1874756000378624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787907051.137478:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907051.137491:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cae2aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae2a3 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.137508:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cae2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae2a3 expref: 8 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.137517:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa541c96600/0x72bb6cf063cae2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae2a3 expref: 8 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.137525:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96600, rc 0) 00000100:00100000:2.0:1787907051.137569:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+8:14359:x1874756000378624:12345-0@lo:101:mount.lustre.0 Request processed in 104us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907051.137576:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787907051.137724:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f788a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000378624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787907051.137737:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cae2a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae2aa expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907051.137745:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cae2a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae2aa expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907051.137800:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f788a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000378752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787907051.137858:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907051.137883:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa506992900 going to sleep for 11 seconds 00000100:00100000:2.0:1787907051.138001:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000378752 00000100:00100000:2.0:1787907051.138015:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000378752 00000100:00100000:2.0:1787907051.138050:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787907051.138066:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+8:14359:x1874756000378752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787907051.138609:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+9:14359:x1874756000378752:12345-0@lo:501:mount.lustre.0 Request processed in 550us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907051.138616:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787907051.138980:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f788a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000378752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787907051.139040:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f788a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000378880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787907051.139187:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907051.139212:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa506992900 going to sleep for 11 seconds 00000100:00100000:2.0:1787907051.139269:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000378880 00000100:00100000:2.0:1787907051.139275:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000378880 00000100:00100000:2.0:1787907051.139309:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787907051.139316:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+9:14359:x1874756000378880:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787907051.140074:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+9:14359:x1874756000378880:12345-0@lo:503:mount.lustre.0 Request processed in 755us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907051.140084:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787907051.141209:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f788a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000378880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787907051.146869:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ebba1202-2d0e-4d1e-8963-43f853425a20:14395:1874756000379008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787907051.146980:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907051.147910:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa51860b780 going to sleep for 11 seconds 00000100:00100000:3.0:1787907051.148034:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000379008 00000100:00100000:3.0:1787907051.148043:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000379008 00000100:00100000:3.0:1787907051.148116:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787907051.148128:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+9:14395:x1874756000379008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787907051.148582:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+9:14395:x1874756000379008:12345-0@lo:502:llog_process_th.0 Request processed in 454us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907051.148591:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787907051.148969:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ebba1202-2d0e-4d1e-8963-43f853425a20:14395:1874756000379008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787907051.149009:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787907051.149023:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787907051.149026:0:14395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787907051.149032:0:14395:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787907051.149035:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787907051.149063:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8aa510bd0000) 00000020:00000080:0.0:1787907051.149089:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787907051.149096:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787907051.149188:0:14395:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787907051.149197:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bb6cf063cae2b8 00000020:00000080:0.0:1787907051.149577:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787907051.149582:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787907051.149591:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787907051.149593:0:14395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787907051.149597:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787907051.149600:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787907051.149601:0:14395:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787907051.149604:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787907051.149612:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8aa510bd3370) 00000020:00000080:0.0:1787907051.149624:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787907051.149628:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787907051.149629:0:14395:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787907051.149633:0:14395:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787907051.149639:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787907051.149682:0:14395:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa52f19c000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787907051.149773:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8aa510bd19b8) 00000020:00000080:0.0:1787907051.149784:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787907051.149874:0:14395:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787907051.149882:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bb6cf063cae2cd 00000020:00000080:0.0:1787907051.149967:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787907051.149973:0:14395:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787907051.149977:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x72bb6cf063cae2d4 00080000:01000000:0.0:1787907051.149982:0:14395:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787907051.149985:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bb6cf063cae2db 00010000:00010000:2.0:1787907051.238690:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787907051.240315:0:14395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787907051.242021:0:14395:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787907051.243269:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8aa52ebc19b8) 00000020:00000080:2.0:1787907051.243297:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787907051.243411:0:14395:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787907051.243432:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bb6cf063cae2e9 00000020:00000080:0.0:1787907051.250786:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787907051.258261:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x72bb6cf063cae2f0 00000020:00000080:2.0:1787907051.258763:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787907051.258776:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787907051.258783:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907051.258786:0:14395:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787907051.258790:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787907051.258793:0:14395:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1787907051.258796:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787907051.258797:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787907051.258805:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787907051.258808:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907051.258941:0:14395:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787907051.258947:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787907051.258954:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907051.258955:0:14395:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787907051.258960:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787907051.258998:0:14395:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787907051.259012:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787907051.259015:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907051.259017:0:14395:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787907051.259020:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787907051.259023:0:14395:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787907051.259026:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907051.259028:0:14395:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787907051.259031:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787907051.259037:0:14395:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1787907051.259077:0:14395:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787907051.259080:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787907051.259094:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8aa52ebc3370) 00000020:00000080:2.0:1787907051.259107:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787907051.259112:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787907051.259173:0:14395:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787907051.259179:0:14395:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787907051.259189:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bb6cf063cae2fe 00010000:00080000:2.0:1787907051.259229:0:14395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa53b055000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1787907051.259482:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787907051.259968:0:14395:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787907051.260016:0:14395:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787907051.261405:0:14395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787907051.261556:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787907051.261681:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787907051.262749:0:14399:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787907051.262756:0:14399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787907051.263682:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787907051.263695:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787907051.263727:0:14395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787907051.263746:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bb6cf063cae305 00000100:00080000:0.0:1787907051.263757:0:14395:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787907051.263762:0:14395:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8aa53b055000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1787907051.263981:0:14395:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa535e8a300 x1874756000379136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787907051.264128:0:14395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1787907051.264191:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000379136:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787907051.264289:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874756000379136 offset 0 length 520: 4 00000020:01000000:0.0:1787907051.264467:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787907051.264471:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787907051.264473:0:14395:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787907051.264476:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787907051.264479:0:14395:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1787907051.264481:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787907051.264483:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787907051.264484:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787907051.264487:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787907051.264488:0:14395:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787907051.264490:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787907051.264494:0:14395:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787907051.264498:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787907051.264500:0:14395:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787907051.264502:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787907051.264507:0:14395:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:0.0:1787907051.264532:0:14395:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787907051.264535:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787907051.264548:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8aa510bd4d28) 00000020:00000080:0.0:1787907051.264561:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787907051.264566:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787907051.264633:0:14395:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787907051.264639:0:14395:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787907051.264646:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bb6cf063cae313 00010000:00080000:0.0:1787907051.264675:0:14395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa541c77000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1787907051.264926:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787907051.265191:0:14395:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787907051.265221:0:14395:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787907051.265796:0:14395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787907051.265900:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787907051.265975:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787907051.266783:0:14401:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787907051.266789:0:14401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787907051.268131:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787907051.268149:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787907051.268192:0:14395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787907051.268215:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bb6cf063cae31a 00000100:00080000:2.0:1787907051.268228:0:14395:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787907051.268235:0:14395:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8aa541c77000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1787907051.268279:0:14395:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa53495dc00 x1874756000379264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787907051.268363:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000379264:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787907051.268458:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874756000379264 offset 0 length 520: 4 00000100:00080000:2.0:1787907051.268518:0:14395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787907051.268640:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787907051.268645:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907051.268648:0:14395:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787907051.268651:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787907051.268655:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907051.268656:0:14395:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787907051.268659:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787907051.268661:0:14395:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787907051.268664:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787907051.268666:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907051.268668:0:14395:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787907051.268670:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787907051.268673:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907051.268674:0:14395:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787907051.268677:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787907051.268710:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ebba1202-2d0e-4d1e-8963-43f853425a20:14395:1874756000379392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787907051.268761:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907051.268796:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000379392 00000100:00100000:2.0:1787907051.268803:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000379392 00000100:00100000:2.0:1787907051.268869:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787907051.268879:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+9:14395:x1874756000379392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787907051.269156:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+9:14395:x1874756000379392:12345-0@lo:502:llog_process_th.0 Request processed in 278us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907051.269165:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787907051.269210:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53f70bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787907051.269231:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ebba1202-2d0e-4d1e-8963-43f853425a20:14395:1874756000379392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787907051.269257:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787907051.269261:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907051.269263:0:14395:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787907051.269267:0:14395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787907051.269331:0:14359:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787907051.269355:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787907051.269373:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cae2a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae2aa expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.269384:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa500030c00/0x72bb6cf063cae2a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae2aa expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787907051.269393:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8aa52f19c000 from 1 10000000:01000000:2.0:1787907051.269396:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787907051.269440:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.269449:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.269459:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907051.269473:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000379520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787907051.269511:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907051.269529:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53f70bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787907051.270198:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000379520 00000100:00100000:1.0:1787907051.270207:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000379520 00000100:00100000:1.0:1787907051.270253:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787907051.270263:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+9:14359:x1874756000379520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787907051.270276:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907051.270293:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa508210e00/0x72bb6cf063cae328 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae321 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.270316:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508210e00/0x72bb6cf063cae328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae321 expref: 10 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.270325:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa508210e00/0x72bb6cf063cae328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae321 expref: 10 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.270335:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508210e00, rc 0) 00000100:00100000:1.0:1787907051.270554:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+10:14359:x1874756000379520:12345-0@lo:101:mount.lustre.0 Request processed in 290us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907051.270562:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787907051.270732:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000379520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787907051.270750:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae328 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907051.270759:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae328 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907051.271777:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000379648:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787907051.272147:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907051.272238:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787907051.272357:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000379648 00000100:00100000:2.0:1787907051.272508:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000379648 00000100:00100000:2.0:1787907051.272588:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787907051.272599:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+10:14359:x1874756000379648:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787907051.272752:0:14371:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787907051.272762:0:14371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787907051.272909:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+10:14359:x1874756000379648:12345-0@lo:256:mount.lustre.0 Request processed in 312us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907051.272917:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787907051.273003:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000379648:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787907051.273597:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787907051.273633:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae328 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.273643:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae328 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787907051.273652:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa52f19c000 from 1 10000000:01000000:0.0:1787907051.273655:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787907051.273686:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.273695:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.273704:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907051.273782:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000379776:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787907051.273850:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907051.274518:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787907051.274603:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000379776 00000100:00100000:1.0:1787907051.274612:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000379776 00000100:00100000:1.0:1787907051.274705:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787907051.274713:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+10:14359:x1874756000379776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787907051.274726:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907051.274743:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cae336 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae32f expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.274780:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cae336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae32f expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.274789:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cae336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae32f expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.274798:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211a00, rc 0) 00000100:00100000:1.0:1787907051.274871:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+11:14359:x1874756000379776:12345-0@lo:101:mount.lustre.0 Request processed in 158us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907051.274877:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787907051.275076:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000379776:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787907051.275090:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae336 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.275098:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae336 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907051.275153:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000379904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787907051.275180:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907051.275205:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787907051.275298:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000379904 00000100:00100000:1.0:1787907051.275303:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000379904 00000100:00100000:1.0:1787907051.275335:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787907051.275342:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+11:14359:x1874756000379904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787907051.275752:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+11:14359:x1874756000379904:12345-0@lo:501:mount.lustre.0 Request processed in 410us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907051.275760:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787907051.275935:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000379904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787907051.275967:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000380032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787907051.276009:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907051.276026:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787907051.276097:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000380032 00000100:00100000:2.0:1787907051.276103:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000380032 00000100:00100000:2.0:1787907051.276127:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787907051.276135:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+11:14359:x1874756000380032:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787907051.276301:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+11:14359:x1874756000380032:12345-0@lo:503:mount.lustre.0 Request processed in 166us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907051.276308:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787907051.276455:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000380032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787907051.276806:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ebba1202-2d0e-4d1e-8963-43f853425a20:14403:1874756000380160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787907051.276870:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907051.276895:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa51860bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787907051.276989:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000380160 00000100:00100000:2.0:1787907051.276995:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000380160 00000100:00100000:2.0:1787907051.277027:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787907051.277034:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+11:14403:x1874756000380160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787907051.277259:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+11:14403:x1874756000380160:12345-0@lo:502:llog_process_th.0 Request processed in 224us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907051.277267:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787907051.277346:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ebba1202-2d0e-4d1e-8963-43f853425a20:14403:1874756000380160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787907051.277371:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787907051.277381:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787907051.277383:0:14403:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787907051.277389:0:14403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa52f19c000 00000020:00000080:0.0:1787907051.277393:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787907051.277407:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787907051.277410:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787907051.277411:0:14403:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787907051.277414:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787907051.277417:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787907051.277428:0:14403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787907051.277433:0:14403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa52f19c000 00000020:00000080:0.0:1787907051.277435:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787907051.277495:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787907051.277499:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787907051.277500:0:14403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787907051.277503:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787907051.277506:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787907051.277507:0:14403:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787907051.277511:0:14403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8aa52f19c000 00000020:00000080:0.0:1787907051.277513:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787907051.277550:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ebba1202-2d0e-4d1e-8963-43f853425a20:14403:1874756000380288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787907051.277588:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907051.277603:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787907051.279551:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000380288 00000100:00100000:3.0:1787907051.279564:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000380288 00000100:00100000:0.0:1787907051.279736:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787907051.279748:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+11:14403:x1874756000380288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787907051.280033:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+11:14403:x1874756000380288:12345-0@lo:502:llog_process_th.0 Request processed in 286us (2444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907051.280042:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787907051.280468:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ebba1202-2d0e-4d1e-8963-43f853425a20:14403:1874756000380288:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787907051.280506:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787907051.280515:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787907051.280517:0:14403:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787907051.280521:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787907051.280595:0:14359:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787907051.280626:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787907051.280652:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae336 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.280665:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae336 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787907051.280712:0:14359:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787907051.280715:0:14359:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8aa52f19c000 10000000:01000000:0.0:1787907051.280718:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8aa52f19c000 10000000:01000000:0.0:1787907051.280722:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787907051.280728:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8aa52f19c000 from 1 10000000:01000000:0.0:1787907051.280731:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787907051.280769:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fa00/0x72bb6cf063cae33d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.280777:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fa00/0x72bb6cf063cae33d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.280786:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fa00/0x72bb6cf063cae33d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907051.280806:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000380416:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787907051.280883:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907051.280907:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9000 going to sleep for 11 seconds 00000100:00100000:0.0:1787907051.280923:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000380416 00000100:00100000:0.0:1787907051.280929:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000380416 00000100:00100000:0.0:1787907051.280954:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787907051.280961:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+11:14359:x1874756000380416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787907051.280971:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907051.280989:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cae344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae33d expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.281013:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cae344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae33d expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.281025:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa53ac8ea00/0x72bb6cf063cae344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae33d expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.281034:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8ea00, rc 0) 00000100:00100000:0.0:1787907051.282366:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14359:x1874756000380416:12345-0@lo:101:mount.lustre.0 Request processed in 1398us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907051.282377:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787907051.282453:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000380416:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787907051.282475:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fa00/0x72bb6cf063cae33d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae344 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907051.282487:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fa00/0x72bb6cf063cae33d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae344 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907051.282553:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000380544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787907051.282591:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907051.282617:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9000 going to sleep for 11 seconds 00000100:00100000:1.0:1787907051.282763:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000380544 00000100:00100000:1.0:1787907051.282770:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000380544 00000100:00100000:1.0:1787907051.282838:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787907051.282848:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14359:x1874756000380544:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787907051.283124:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14359:x1874756000380544:12345-0@lo:501:mount.lustre.0 Request processed in 278us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907051.283142:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787907051.284229:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000380544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787907051.284293:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000380672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787907051.284358:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907051.284388:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9000 going to sleep for 11 seconds 00000100:00100000:0.0:1787907051.284428:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000380672 00000100:00100000:0.0:1787907051.284434:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000380672 00000100:00100000:0.0:1787907051.284468:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787907051.284476:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14359:x1874756000380672:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787907051.284647:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14359:x1874756000380672:12345-0@lo:503:mount.lustre.0 Request processed in 170us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907051.284655:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787907051.284699:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000380672:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787907051.291277:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ebba1202-2d0e-4d1e-8963-43f853425a20:14405:1874756000380800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787907051.291393:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907051.291459:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000380800 00000100:00100000:1.0:1787907051.291467:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000380800 00000100:00100000:1.0:1787907051.291511:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787907051.291521:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14405:x1874756000380800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787907051.291781:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14405:x1874756000380800:12345-0@lo:502:llog_process_th.0 Request processed in 260us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907051.291790:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787907051.291867:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa51860bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787907051.291889:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ebba1202-2d0e-4d1e-8963-43f853425a20:14405:1874756000380800:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787907051.291949:0:14405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787907051.291965:0:14405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8aa5187c8000) 00000020:00000080:1.0:1787907051.291985:0:14405:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787907051.292055:0:14405:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa52f19c000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787907051.292059:0:14405:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa52f19c000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787907051.292061:0:14405:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa52f19c000 4 00010000:00080000:1.0:1787907051.292089:0:14405:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa535dbe000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1787907051.293737:0:14405:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787907051.299640:0:14405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787907051.299692:0:14405:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787907051.299710:0:14405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x72bb6cf063cae352 00000100:00080000:1.0:1787907051.299722:0:14405:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787907051.299727:0:14405:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8aa535dbe000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1787907051.299767:0:14405:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa4037a7100 x1874756000380928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787907051.299840:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874756000380928:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787907051.299928:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907051.300006:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000380928 00000100:00100000:1.0:1787907051.300013:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000380928 00000100:00100000:1.0:1787907051.300043:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787907051.300050:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1874756000380928:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787907051.301168:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1874756000380928:12345-0@lo:38:llog_process_th.0 Request processed in 1114us (1238us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787907051.301178:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787907051.301232:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787907051.301240:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa535dbe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787907051.301255:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787907051.301259:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874756000380928:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787907051.301302:0:14405:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787907051.303013:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ebba1202-2d0e-4d1e-8963-43f853425a20:14405:1874756000381056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787907051.304208:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907051.304277:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa51860b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787907051.304472:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000381056 00000100:00100000:2.0:1787907051.304481:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000381056 00000100:00100000:2.0:1787907051.304540:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787907051.304550:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14405:x1874756000381056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787907051.305975:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14405:x1874756000381056:12345-0@lo:502:llog_process_th.0 Request processed in 1420us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907051.305989:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787907051.306693:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ebba1202-2d0e-4d1e-8963-43f853425a20:14405:1874756000381056:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787907051.306750:0:14405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787907051.306869:0:14359:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787907051.306889:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787907051.306908:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fa00/0x72bb6cf063cae33d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae344 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.306919:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fa00/0x72bb6cf063cae33d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae344 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787907051.306973:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787907051.306975:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787907051.306977:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787907051.306978:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787907051.306980:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787907051.306981:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787907051.306982:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787907051.306984:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787907051.306986:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787907051.306988:0:14359:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787907051.306992:0:14359:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787907051.306994:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787907051.306995:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787907051.306997:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787907051.306998:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787907051.306999:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787907051.307000:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787907051.307001:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787907051.307002:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787907051.307003:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787907051.307004:0:14359:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787907051.307027:0:14359:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787907051.307043:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000381184:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787907051.308223:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907051.308279:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa51860b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787907051.308325:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000381184 00000100:00100000:1.0:1787907051.308334:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000381184 00000100:00100000:1.0:1787907051.308393:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787907051.308404:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14359:x1874756000381184:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787907051.308464:0:14369:0:(mgs_handler.c:454:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787907051.308483:0:14369:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787907051.414343:0:14369:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787907051.414361:0:14369:0:(mgs_handler.c:675:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787907051.414431:0:14393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787907051.414436:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787907051.414459:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.414479:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa508210e00/0x72bb6cf063cae328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae321 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.414488:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.414531:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa508210e00/0x72bb6cf063cae328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cae321 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.414546:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa508210e00/0x72bb6cf063cae328 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cae321 expref: 12 pid: 14372 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907051.414562:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1874756000381312:0@lo:104: 00000100:00100000:1.0:1787907051.414640:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907051.414684:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa503c62b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787907051.415387:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000381312 00000100:00100000:1.0:1787907051.415401:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000381312 00000100:00100000:1.0:1787907051.415499:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787907051.415511:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ebba1202-2d0e-4d1e-8963-43f853425a20+3:14393:x1874756000381312:12345-0@lo:104: 00010000:00010000:1.0:1787907051.415531:0:14360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cae328 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907051.415614:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787907051.415633:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ebba1202-2d0e-4d1e-8963-43f853425a20+3:14393:x1874756000381312:12345-0@lo:104: Request processed in 125us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907051.415642:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787907051.415758:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1874756000381312:0@lo:104: 00010000:00010000:0.0:1787907051.415786:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.417686:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907051.417722:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cae328 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.417736:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96000 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:2.0:1787907051.417741:0:14366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cae328 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.417753:0:14366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cae328 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787907051.417762:0:14366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cae328 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787907051.417769:0:14366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787907051.417855:0:14366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae328 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.417862:0:14366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787907051.417883:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae328 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.417889:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa541c96000/0x72bb6cf063cae321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae328 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.418503:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907051.418507:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907051.418510:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787907051.418573:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ebba1202-2d0e-4d1e-8963-43f853425a20:3302:1874756000381440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787907051.418684:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907051.419330:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000381440 00000100:00100000:2.0:1787907051.419340:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000381440 00010000:00010000:2.0:1787907051.419375:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa508210e00/0x72bb6cf063cae328 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cae321 expref: 13 pid: 14372 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907051.419412:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787907051.419434:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ebba1202-2d0e-4d1e-8963-43f853425a20+13:3302:x1874756000381440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787907051.419448:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787907051.419453:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa508210e00/0x72bb6cf063cae328 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cae321 expref: 13 pid: 14372 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.419467:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa508210e00/0x72bb6cf063cae328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cae321 expref: 13 pid: 14372 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.419486:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa508210e00/0x72bb6cf063cae328 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cae321 expref: 13 pid: 14372 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.419503:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.419511:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787907051.419527:0:14362:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005091735s 00010000:00010000:2.0:1787907051.419544:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.419551:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.419558:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.419566:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.419571:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210000 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907051.419578:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.419586:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.419604:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.419614:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787907051.419666:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ebba1202-2d0e-4d1e-8963-43f853425a20+12:3302:x1874756000381440:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907051.419674:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787907051.422022:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ebba1202-2d0e-4d1e-8963-43f853425a20:3302:1874756000381440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787907051.422842:0:14393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.422857:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907051.422881:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae359 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907051.431748:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+11:14359:x1874756000381184:12345-0@lo:253:mount.lustre.0 Request processed in 123334us (123517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907051.431781:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787907051.433516:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:14359:1874756000381184:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787907051.433538:0:14359:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787907051.433542:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787907051.433544:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787907051.433545:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787907051.433546:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787907051.433547:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787907051.433549:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787907051.433550:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787907051.433552:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787907051.433553:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787907051.433555:0:14359:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787907051.433574:0:14359:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787907051.441550:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787907051.441909:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787907051.442363:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787907051.442529:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787907051.443353:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787907051.443533:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787907051.448596:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787907051.449372:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787907051.450038:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787907051.450489:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787907051.451147:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787907051.451325:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787907051.498598:0:14359:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787907051.499339:0:14359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787907051.499575:0:14415:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787907051.499579:0:14415:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787907051.499690:0:14416:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787907051.499775:0:14416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787907051.504321:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787907051.504620:0:14416:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787907051.504626:0:14416:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1787907051.513301:0:14359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787907051.513490:0:14359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787907051.514484:0:14359:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787907051.514496:0:14359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787907051.514643:0:14359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787907051.516407:0:14359:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787907051.519240:0:14359:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787907051.519357:0:14359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787907051.526394:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787907051.542594:0:14359:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787907051.591170:0:14359:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787907051.591213:0:14359:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb866c0dab988 00100000:10000000:3.0:1787907051.591222:0:14359:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787907051.592422:0:14359:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787907051.592444:0:14359:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787907051.592459:0:14359:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787907051.592492:0:14359:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787907051.936340:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787907052.388212:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787907052.457902:0:14374:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787907052.457912:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8aa52f19c000 from 6 10000000:01000000:0.0:1787907052.457918:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787907052.457977:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907052.457988:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907052.457999:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907052.458027:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000381568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787907052.459336:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907052.459643:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9900 going to sleep for 11 seconds 00000100:00100000:2.0:1787907052.461161:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000381568 00000100:00100000:2.0:1787907052.461178:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000381568 00000100:00100000:2.0:1787907052.461249:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787907052.461260:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+11:14374:x1874756000381568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787907052.461277:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907052.461316:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cae367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae360 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907052.461350:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cae367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae360 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907052.461362:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cae367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae360 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907052.461372:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c96800, rc 0) 00000100:00100000:2.0:1787907052.461463:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14374:x1874756000381568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907052.461470:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787907052.462994:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000381568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787907052.463021:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae367 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907052.463032:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae367 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907052.463102:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000381696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787907052.463155:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907052.463191:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787907052.463793:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000381696 00000100:00100000:1.0:1787907052.463801:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000381696 00000100:00100000:1.0:1787907052.463883:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787907052.463891:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14374:x1874756000381696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787907052.463911:0:14372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787907052.463930:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787907052.463933:0:14372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787907052.464948:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14374:x1874756000381696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1051us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907052.464969:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787907052.465154:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000381696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787907052.465219:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787907052.465231:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae367 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907052.465349:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae367 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907052.981791:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787907053.412274:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787907053.984840:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907055.008084:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907056.034866:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787907056.532217:0:14659:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787907056.805803:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787907056.805824:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787907056.805827:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787907056.805830:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787907056.805843:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787907056.805846:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787907056.805850:0:36:0:(import.c:65:import_set_state_nolock()) ffff8aa535dbe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787907056.805863:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8aa535dbe000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1787907056.805886:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa53495ca80 x1874756000381952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787907056.805933:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787907056.805960:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ebba1202-2d0e-4d1e-8963-43f853425a20:3304:1874756000381824:0@lo:400:kworker.0 00000100:00100000:2.0:1787907056.806028:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907056.806091:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874756000381952:0@lo:38:kworker.0 00000100:00100000:2.0:1787907056.806125:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907056.808077:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000381824 00000100:00100000:3.0:1787907056.808106:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000381824 00000100:00100000:3.0:1787907056.808168:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787907056.808179:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+12:3304:x1874756000381824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787907056.808285:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+12:3304:x1874756000381824:12345-0@lo:400:kworker.0 Request processed in 108us (2257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907056.808293:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787907056.808364:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000381952 00000100:00100000:3.0:1787907056.808368:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000381952 00000100:00100000:3.0:1787907056.808393:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787907056.808398:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3300:x1874756000381952:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787907056.808425:0:14379:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:3.0:1787907056.808477:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x72bb6cf063cae36e 00000004:00100000:3.0:1787907056.808495:0:14379:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787907056.808657:0:14379:0:(import.c:65:import_set_state_nolock()) ffff8aa509edb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787907056.808709:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874756000381952:12345-0@lo:38:kworker.0 Request processed in 310us (2583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907056.808716:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787907056.808802:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ebba1202-2d0e-4d1e-8963-43f853425a20:3304:1874756000381824:0@lo:400:kworker.0 00010000:00080000:3.0:1787907056.809041:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8aa53495ca80 x1874756000381952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787907066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787907056.809056:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787907056.809063:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787907056.809068:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787907056.809071:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa535dbe000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787907056.809078:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874756000381952:0@lo:38:kworker.0 00010000:00010000:2.0:1787907057.057116:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907058.083078:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907059.104219:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787907059.954461:0:14809:0:(class_obd.c:354:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe148598c0 20000000:00000080:0.0:1787907059.954482:0:14809:0:(mgs_handler.c:1205:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8aa535378c00 uarg=0000000000000000 20000000:01000000:0.0:1787907059.954520:0:14809:0:(mgs_llog.c:6200:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787907059.954528:0:14809:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787907059.954533:0:14809:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787907059.955424:0:14810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787907059.955585:0:14809:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787907059.963078:0:14809:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787907059.963503:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907059.963546:0:14809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cae336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae32f expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907059.963557:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907059.963664:0:14809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cae336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cae32f expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907059.963690:0:14809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cae336 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cae32f expref: 11 pid: 14372 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907059.963707:0:14809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f788a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14809:1874756000382080:0@lo:104: 00000100:00100000:3.0:1787907059.963935:0:14809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907059.964014:0:14809:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3540 going to sleep for 11 seconds 00000100:00100000:1.0:1787907059.964127:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000382080 00000100:00100000:1.0:1787907059.964138:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000382080 00000100:00100000:1.0:1787907059.964238:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787907059.964262:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ebba1202-2d0e-4d1e-8963-43f853425a20+3:14809:x1874756000382080:12345-0@lo:104: 00010000:00010000:1.0:1787907059.964293:0:14360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cae336 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907059.964372:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787907059.964379:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ebba1202-2d0e-4d1e-8963-43f853425a20+3:14809:x1874756000382080:12345-0@lo:104: Request processed in 131us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907059.964388:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787907059.964399:0:14809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f788a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14809:1874756000382080:0@lo:104: 00010000:00010000:0.0:1787907059.964423:0:14809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.965089:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907059.965110:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cae336 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.965119:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8fe00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:2.0:1787907059.965124:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cae336 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.965133:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cae336 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787907059.965139:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cae336 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787907059.965145:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787907059.965189:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae336 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.965197:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787907059.965227:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae336 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.965257:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8fe00/0x72bb6cf063cae32f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae336 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.965297:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907059.965300:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907059.965302:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787907059.965486:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ebba1202-2d0e-4d1e-8963-43f853425a20:3304:1874756000382208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787907059.965542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907059.965667:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000382208 00000100:00100000:2.0:1787907059.965674:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000382208 00010000:00010000:2.0:1787907059.965703:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cae336 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cae32f expref: 12 pid: 14372 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907059.965742:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787907059.965750:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ebba1202-2d0e-4d1e-8963-43f853425a20+12:3304:x1874756000382208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787907059.965766:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787907059.965771:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cae336 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cae32f expref: 12 pid: 14372 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.965782:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cae336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cae32f expref: 12 pid: 14372 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.965795:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa508211a00/0x72bb6cf063cae336 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cae32f expref: 12 pid: 14372 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.965877:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.966176:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.966209:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.966217:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.966224:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.966231:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.966237:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031600 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907059.966241:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.966571:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.966597:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907059.966609:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787907059.966680:0:14809:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907059.966691:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907059.966699:0:14809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa500031600/0x72bb6cf063cae375 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907059.966739:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ebba1202-2d0e-4d1e-8963-43f853425a20+11:3304:x1874756000382208:12345-0@lo:103:ldlm_bl.0 Request processed in 985us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907059.966751:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787907059.971574:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ebba1202-2d0e-4d1e-8963-43f853425a20:3304:1874756000382208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787907060.131632:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907061.154184:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787907061.730969:0:14374:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787907061.730979:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa52f19c000 from 10 10000000:01000000:2.0:1787907061.730986:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787907061.731050:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907061.731062:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907061.731074:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907061.731099:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000382336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787907061.731188:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907061.731499:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed82540 going to sleep for 11 seconds 00000100:00100000:0.0:1787907061.732083:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000382336 00000100:00100000:0.0:1787907061.732095:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000382336 00000100:00100000:0.0:1787907061.732223:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787907061.732236:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+11:14374:x1874756000382336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787907061.732254:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907061.732274:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa53ac8e600/0x72bb6cf063cae383 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae37c expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907061.732319:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa53ac8e600/0x72bb6cf063cae383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae37c expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907061.732332:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa53ac8e600/0x72bb6cf063cae383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae37c expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907061.732342:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8e600, rc 0) 00000100:00100000:0.0:1787907061.732421:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14374:x1874756000382336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907061.732429:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787907061.732509:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000382336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787907061.732537:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae383 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907061.732548:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae383 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907061.732626:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000382464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787907061.732659:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907061.733154:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed82540 going to sleep for 11 seconds 00000100:00100000:3.0:1787907061.733273:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000382464 00000100:00100000:3.0:1787907061.733280:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000382464 00000100:00100000:3.0:1787907061.733316:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787907061.733335:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14374:x1874756000382464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787907061.733700:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14374:x1874756000382464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907061.733707:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787907061.734157:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000382464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787907061.735096:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000382592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787907061.735163:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907061.735258:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534fd3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787907061.735304:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000382592 00000100:00100000:0.0:1787907061.735311:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000382592 00000100:00100000:0.0:1787907061.735367:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787907061.735375:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14374:x1874756000382592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787907061.735622:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+12:14374:x1874756000382592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 247us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907061.735630:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787907061.736253:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000382592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787907061.737667:0:14877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787907061.738289:0:14374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787907061.738315:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787907061.738327:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae383 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907061.738340:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae383 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907061.920230:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787907051/real 1787907051] req@ffff8aa53495dc00 x1874756000379264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787907061 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907061.920293:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8aa53495dc00 x1874756000379264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787907061 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907061.920305:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787907051/real 1787907051] req@ffff8aa535e8a300 x1874756000379136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787907061 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907061.920320:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8aa535e8a300 x1874756000379136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787907061 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787907061.920371:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa541c77000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787907061.920393:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787907061.920397:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000379264:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787907061.920404:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa53b055000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787907061.920409:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787907061.920412:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000379136:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787907061.920704:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787907061.920709:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787907061.920712:0:8:0:(import.c:65:import_set_state_nolock()) ffff8aa53b055000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787907061.920718:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 489 00000100:00080000:1.0:1787907061.920724:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787907061.920733:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8aa53b055000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1787907061.920779:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa4037a5c00 x1874756000382720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787907061.920840:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787907061.920843:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787907061.920845:0:8:0:(import.c:65:import_set_state_nolock()) ffff8aa541c77000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787907061.921137:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000382720:0@lo:8:kworker.0 00000400:00000100:3.0:1787907061.921198:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874756000382720 offset 0 length 520: 4 00000100:00080000:1.0:1787907061.921523:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 489 00000100:00080000:1.0:1787907061.922167:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787907061.922177:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8aa541c77000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1787907061.922252:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa4037a4700 x1874756000382848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787907061.922352:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000382976:0@lo:400:kworker.0 00000100:00100000:1.0:1787907061.922428:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907061.922500:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000382976 00000100:00100000:1.0:1787907061.922509:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000382976 00000100:00100000:0.0:1787907061.922953:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000382848:0@lo:8:kworker.0 00000400:00000100:0.0:1787907061.922978:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874756000382848 offset 0 length 520: 4 00000100:00100000:1.0:1787907061.925520:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787907061.925907:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000382976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787907061.926015:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000382976:12345-0@lo:400:kworker.0 Request processed in 172us (3587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907061.926025:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787907061.926085:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8aa4037a5180 x1874756000382976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787907061.926102:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000382976:0@lo:400:kworker.0 00010000:00010000:1.0:1787907062.176123:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907063.201841:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787907063.651332:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787907064.224514:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907065.249232:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787907065.868364:0:15058:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787907065.868369:0:15058:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787907065.868515:0:15058:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8aa5131e2000 00000020:01000004:3.0:1787907065.868532:0:15058:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787907065.868544:0:15058:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787907065.868558:0:15058:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8aa507394d28) 00000020:00000080:3.0:1787907065.868573:0:15058:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787907065.963636:0:15058:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787907065.967437:0:15058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787907065.968631:0:15058:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787907065.971494:0:15058:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787907065.971740:0:15058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787907065.976595:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 361: rc = 0 00100000:10000000:2.0:1787907065.976716:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 361: rc = 0 00100000:10000000:3.0:1787907066.001026:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 361: rc = 0 00100000:10000000:3.0:1787907066.001663:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 663: rc = 0 00100000:10000000:3.0:1787907066.001990:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 663: rc = 0 00100000:10000000:3.0:1787907066.002352:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 663: rc = 0 00100000:10000000:3.0:1787907066.006164:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 663: rc = 0 00100000:10000000:3.0:1787907066.006488:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 663: rc = 0 00100000:10000000:3.0:1787907066.007542:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 663: rc = 0 00000020:00000080:3.0:1787907066.012607:0:15058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787907066.012621:0:15058:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787907066.012634:0:15058:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72bb6cf063cae391 00000020:01000004:3.0:1787907066.012643:0:15058:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787907066.012666:0:15058:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787907066.012669:0:15058:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787907066.012675:0:15058:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787907066.012680:0:15058:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787907066.012691:0:15058:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8aa507390000) 00000020:00000080:3.0:1787907066.012700:0:15058:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787907066.019762:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787907066.024856:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787907066.024868:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787907066.038455:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787907066.038468:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787907066.040529:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787907066.040541:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787907066.051443:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787907066.051677:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787907066.051684:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787907066.053285:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787907066.053301:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787907066.085517:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787907066.085759:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787907066.085766:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787907066.088277:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787907066.088292:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787907066.089329:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787907066.089339:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787907066.091284:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787907066.091480:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787907066.091487:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787907066.094039:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787907066.094053:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787907066.145492:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787907066.146090:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787907066.146100:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787907066.147681:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787907066.147693:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787907066.148436:0:15058:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787907066.148461:0:15058:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787907066.148468:0:15058:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787907066.158035:0:15058:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787907066.158100:0:15058:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787907066.158106:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787907066.158108:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787907066.158109:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787907066.158110:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787907066.158111:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787907066.158113:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787907066.158114:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787907066.158116:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787907066.158117:0:15058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787907066.158121:0:15058:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787907066.158123:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787907066.158125:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787907066.158126:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787907066.158128:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787907066.158139:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787907066.158140:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787907066.158141:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787907066.158143:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787907066.158144:0:15058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787907066.158188:0:15058:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787907066.158216:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000383104:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787907066.158317:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907066.158454:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5361613c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787907066.158506:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000383104 00000100:00100000:1.0:1787907066.158516:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000383104 00000100:00100000:1.0:1787907066.158615:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787907066.158624:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+12:15058:x1874756000383104:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787907066.158655:0:14372:0:(mgs_handler.c:480:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787907066.158659:0:14372:0:(mgs_handler.c:538:mgs_target_reg()) Checking nodemap for target registration lustre-OST0000 20000000:01000000:1.0:1787907066.158662:0:14372:0:(mgs_handler.c:544:mgs_target_reg()) lustre-OST0000: Nodemap subsystem disabled, allowing target registration 20000000:01000000:1.0:1787907066.158664:0:14372:0:(mgs_handler.c:567:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787907066.158667:0:14372:0:(mgs_handler.c:675:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787907066.164607:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+12:15058:x1874756000383104:12345-0@lo:253:mount.lustre.0 Request processed in 5973us (6279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907066.164623:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787907066.164712:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000383104:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787907066.164729:0:15058:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787907066.164732:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787907066.164734:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787907066.164735:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787907066.164736:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787907066.164738:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787907066.164739:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787907066.164740:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787907066.164742:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787907066.164743:0:15058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787907066.164763:0:15058:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8aa5131e2000 from lustre-OST0000 10000000:01000000:2.0:1787907066.164915:0:15058:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787907066.164918:0:15058:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787907066.164925:0:15058:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8aa5187ccd28 local copy 00010000:00010000:2.0:1787907066.164938:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e800/0x72bb6cf063cae287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae28e expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907066.165218:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000383232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787907066.165263:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907066.165356:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9000 going to sleep for 11 seconds 00000100:00100000:0.0:1787907066.165411:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000383232 00000100:00100000:0.0:1787907066.165420:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000383232 00000100:00100000:0.0:1787907066.165524:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787907066.165535:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+12:15058:x1874756000383232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787907066.165704:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+12:15058:x1874756000383232:12345-0@lo:501:mount.lustre.0 Request processed in 171us (441us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787907066.165712:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787907066.165787:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000383232:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787907066.165802:0:15058:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787907066.165961:0:15058:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787907066.165969:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e800/0x72bb6cf063cae287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae28e expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.165991:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e800/0x72bb6cf063cae287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae28e expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787907066.166021:0:15058:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8aa5131e2000 10000000:01000000:2.0:1787907066.166026:0:15058:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787907066.166032:0:15058:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8aa5187ccd28 10000000:01000000:2.0:1787907066.166034:0:15058:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787907066.166038:0:15058:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8aa5187ccd28 from 1 10000000:01000000:2.0:1787907066.166041:0:15058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787907066.166071:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c97200/0x72bb6cf063cae39f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.166080:0:15058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa541c97200/0x72bb6cf063cae39f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.166090:0:15058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa541c97200/0x72bb6cf063cae39f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907066.166106:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000383360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787907066.166150:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907066.166377:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9000 going to sleep for 11 seconds 00000100:00100000:3.0:1787907066.166485:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000383360 00000100:00100000:3.0:1787907066.166491:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000383360 00000100:00100000:3.0:1787907066.166523:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787907066.166530:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+12:15058:x1874756000383360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787907066.166541:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787907066.166557:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa500031e00/0x72bb6cf063cae3a6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae39f expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907066.166578:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa500031e00/0x72bb6cf063cae3a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae39f expref: 13 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907066.166602:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa500031e00/0x72bb6cf063cae3a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae39f expref: 13 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907066.166611:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa500031e00, rc 0) 00000100:00100000:3.0:1787907066.166697:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+13:15058:x1874756000383360:12345-0@lo:101:mount.lustre.0 Request processed in 167us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907066.166704:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787907066.166943:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000383360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787907066.166958:0:15058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa541c97200/0x72bb6cf063cae39f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae3a6 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.166967:0:15058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa541c97200/0x72bb6cf063cae39f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae3a6 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787907066.166997:0:15058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787907066.167048:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c97200/0x72bb6cf063cae39f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae3a6 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.167056:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa541c97200/0x72bb6cf063cae39f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae3a6 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787907066.167062:0:15058:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787907066.167066:0:15058:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787907066.167071:0:15058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787907066.167073:0:15058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787907066.167092:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96c00/0x72bb6cf063cae3ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.167099:0:15058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa541c96c00/0x72bb6cf063cae3ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.167107:0:15058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa541c96c00/0x72bb6cf063cae3ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907066.167123:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000383488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787907066.167164:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907066.167193:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9000 going to sleep for 11 seconds 00000100:00100000:0.0:1787907066.167264:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000383488 00000100:00100000:0.0:1787907066.167270:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000383488 00000100:00100000:0.0:1787907066.167295:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787907066.167301:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+13:15058:x1874756000383488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787907066.167308:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907066.167317:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa53ac8fe00/0x72bb6cf063cae3b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae3ad expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907066.167340:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa53ac8fe00/0x72bb6cf063cae3b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae3ad expref: 14 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907066.167348:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa53ac8fe00/0x72bb6cf063cae3b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae3ad expref: 14 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907066.167355:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8fe00, rc 0) 00000100:00100000:0.0:1787907066.167384:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+14:15058:x1874756000383488:12345-0@lo:101:mount.lustre.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907066.167389:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787907066.167540:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000383488:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787907066.167551:0:15058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa541c96c00/0x72bb6cf063cae3ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae3b4 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.167558:0:15058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa541c96c00/0x72bb6cf063cae3ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae3b4 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787907066.168642:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787907066.170119:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787907066.170446:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787907066.170511:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787907066.170563:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787907066.170614:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787907066.170653:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787907066.171092:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787907066.171186:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787907066.171195:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787907066.171298:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000383616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787907066.171369:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907066.171425:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787907066.171618:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000383616 00000100:00100000:0.0:1787907066.171626:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000383616 00000100:00100000:0.0:1787907066.171689:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787907066.171700:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+14:15058:x1874756000383616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787907066.172306:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+14:15058:x1874756000383616:12345-0@lo:501:mount.lustre.0 Request processed in 606us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907066.172315:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787907066.172414:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000383616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787907066.172458:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000383744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787907066.172541:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907066.172569:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787907066.172623:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000383744 00000100:00100000:1.0:1787907066.172630:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000383744 00000100:00100000:1.0:1787907066.172666:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787907066.172674:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+14:15058:x1874756000383744:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787907066.173187:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+14:15058:x1874756000383744:12345-0@lo:503:mount.lustre.0 Request processed in 511us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907066.173195:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787907066.173297:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000383744:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787907066.174319:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787907066.174397:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000383872:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787907066.174458:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907066.174491:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787907066.174566:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000383872 00000100:00100000:1.0:1787907066.174573:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000383872 00000100:00100000:1.0:1787907066.174615:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787907066.174624:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+14:15058:x1874756000383872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787907066.174958:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+14:15058:x1874756000383872:12345-0@lo:502:mount.lustre.0 Request processed in 335us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907066.174965:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787907066.175041:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000383872:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787907066.175267:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787907066.175312:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787907066.175349:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787907066.175387:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787907066.175415:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787907066.175444:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787907066.175496:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787907066.175537:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787907066.175563:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787907066.175599:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787907066.175630:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787907066.175673:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787907066.175700:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787907066.175737:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907066.175878:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000384000 00000100:00100000:0.0:1787907066.175884:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000384000 00000100:00100000:0.0:1787907066.175909:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787907066.175917:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+14:15058:x1874756000384000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787907066.176045:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+14:15058:x1874756000384000:12345-0@lo:502:mount.lustre.0 Request processed in 129us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907066.176052:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787907066.176399:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787907066.176415:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787907066.176473:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787907066.176482:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787907066.177468:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787907066.177480:0:15073:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787907066.177492:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787907066.177495:0:15073:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787907066.177500:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787907066.177527:0:15073:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8aa50ee1cd28) 00000020:00000080:0.0:1787907066.177556:0:15073:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787907066.177562:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787907066.177634:0:15073:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa5131e2000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787907066.177643:0:15073:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787907066.177655:0:15073:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72bb6cf063cae3c2 00010000:00010000:2.0:1787907066.183214:0:15073:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787907066.183648:0:15073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787907066.186026:0:15073:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787907066.187678:0:15073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787907066.187693:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787907066.187700:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907066.187703:0:15073:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787907066.187706:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787907066.187709:0:15073:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787907066.187711:0:15073:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787907066.187712:0:15073:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787907066.187713:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787907066.187716:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907066.187717:0:15073:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787907066.187720:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787907066.187731:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907066.187733:0:15073:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787907066.187736:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787907066.187738:0:15073:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787907066.187740:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787907066.187742:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907066.187744:0:15073:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787907066.187746:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787907066.187749:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907066.187750:0:15073:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787907066.187753:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787907066.187945:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787907066.187950:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907066.187951:0:15073:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787907066.187955:0:15073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787907066.188124:0:15058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787907066.188167:0:15058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787907066.188195:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c96c00/0x72bb6cf063cae3ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae3b4 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907066.188211:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa541c96c00/0x72bb6cf063cae3ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae3b4 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787907066.188221:0:15058:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa5131e2000 from 1 10000000:01000000:3.0:1787907066.188224:0:15058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787907066.188269:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907066.188279:0:15058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907066.188291:0:15058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907066.188322:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787907066.188414:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907066.188476:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed82840 going to sleep for 11 seconds 00000100:00100000:1.0:1787907066.188603:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000384128 00000100:00100000:1.0:1787907066.188614:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000384128 00000100:00100000:1.0:1787907066.188675:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787907066.188686:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+14:15058:x1874756000384128:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787907066.188703:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907066.188717:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae3d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae3c9 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907066.188745:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae3d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae3c9 expref: 15 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907066.188756:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae3d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae3c9 expref: 15 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907066.188874:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508210000, rc 0) 00000100:00100000:1.0:1787907066.188933:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+15:15058:x1874756000384128:12345-0@lo:101:mount.lustre.0 Request processed in 249us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907066.188940:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787907066.189144:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787907066.189162:0:15058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae3d0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907066.189172:0:15058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae3d0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787907066.192292:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787907066.192973:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787907066.193274:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787907066.193319:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787907066.193390:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787907066.193398:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787907066.193481:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787907066.193550:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907066.193590:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787907066.194059:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000384256 00000100:00100000:0.0:1787907066.194069:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000384256 00000100:00100000:0.0:1787907066.194120:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787907066.194142:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+15:15058:x1874756000384256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787907066.194417:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+15:15058:x1874756000384256:12345-0@lo:501:mount.lustre.0 Request processed in 287us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907066.194426:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787907066.194537:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787907066.194587:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787907066.194634:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907066.194661:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed82840 going to sleep for 11 seconds 00000100:00100000:3.0:1787907066.194924:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000384384 00000100:00100000:3.0:1787907066.194930:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000384384 00000100:00100000:3.0:1787907066.194967:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787907066.194976:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+15:15058:x1874756000384384:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787907066.195139:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+15:15058:x1874756000384384:12345-0@lo:503:mount.lustre.0 Request processed in 154us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907066.195147:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787907066.195188:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384384:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787907066.196345:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787907066.196437:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787907066.196497:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907066.199567:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed82840 going to sleep for 11 seconds 00000100:00100000:2.0:1787907066.200012:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000384512 00000100:00100000:2.0:1787907066.200024:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000384512 00000100:00100000:2.0:1787907066.200090:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787907066.200101:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+15:15058:x1874756000384512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787907066.200415:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+15:15058:x1874756000384512:12345-0@lo:502:mount.lustre.0 Request processed in 315us (3917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907066.200424:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787907066.200546:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787907066.200894:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787907066.200949:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787907066.201015:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787907066.201056:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787907066.201091:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787907066.201154:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787907066.201210:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787907066.201248:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787907066.201290:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787907066.201344:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907066.201388:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed82840 going to sleep for 11 seconds 00000100:00100000:2.0:1787907066.201573:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000384640 00000100:00100000:2.0:1787907066.201580:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000384640 00000100:00100000:2.0:1787907066.201609:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787907066.201618:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+15:15058:x1874756000384640:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787907066.201789:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+15:15058:x1874756000384640:12345-0@lo:502:mount.lustre.0 Request processed in 172us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907066.201797:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787907066.202999:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787907066.203198:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787907066.203214:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787907066.204094:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787907066.204103:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787907066.204106:0:15077:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787907066.204112:0:15077:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa5131e2000 00000020:00000080:3.0:1787907066.204114:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787907066.204122:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787907066.204124:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787907066.204125:0:15077:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787907066.204127:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787907066.204140:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787907066.204142:0:15077:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787907066.204146:0:15077:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa5131e2000 00000020:00000080:3.0:1787907066.204149:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787907066.204205:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787907066.204209:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787907066.204210:0:15077:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787907066.204213:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787907066.204225:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787907066.204226:0:15077:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787907066.204230:0:15077:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8aa5131e2000 00000020:00000080:3.0:1787907066.204232:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787907066.204271:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787907066.204274:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787907066.204275:0:15077:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787907066.204278:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787907066.204312:0:15058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787907066.204338:0:15058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787907066.204354:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae3d0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907066.204365:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae3d0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787907066.204412:0:15058:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787907066.204415:0:15058:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8aa5131e2000 10000000:01000000:3.0:1787907066.204418:0:15058:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8aa5131e2000 10000000:01000000:3.0:1787907066.204422:0:15058:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787907066.204427:0:15058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8aa5131e2000 from 1 10000000:01000000:3.0:1787907066.204430:0:15058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787907066.204465:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cae3d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907066.204473:0:15058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cae3d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907066.204483:0:15058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cae3d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907066.204507:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787907066.204577:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907066.204614:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed82cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787907066.204748:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000384768 00000100:00100000:2.0:1787907066.204756:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000384768 00000100:00100000:2.0:1787907066.204978:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787907066.204989:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+15:15058:x1874756000384768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787907066.205002:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907066.205016:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa541c97000/0x72bb6cf063cae3de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae3d7 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.205040:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c97000/0x72bb6cf063cae3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae3d7 expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.205052:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa541c97000/0x72bb6cf063cae3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae3d7 expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.205060:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa541c97000, rc 0) 00000100:00100000:2.0:1787907066.205100:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15058:x1874756000384768:12345-0@lo:101:mount.lustre.0 Request processed in 113us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907066.205107:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787907066.205201:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787907066.205217:0:15058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cae3d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae3de expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907066.205226:0:15058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cae3d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae3de expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787907066.205949:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787907066.206276:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787907066.206534:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787907066.206581:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787907066.206620:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787907066.206688:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787907066.206725:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787907066.207686:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787907066.207759:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787907066.208290:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787907066.208367:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787907066.208405:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787907066.208455:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787907066.208505:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787907066.208541:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787907066.208575:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787907066.208636:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787907066.208671:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787907066.208704:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787907066.208755:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787907066.210287:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787907066.210363:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787907066.210537:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787907066.210581:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787907066.210674:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787907066.210724:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787907066.211520:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787907066.211671:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787907066.211749:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787907066.212161:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787907066.212273:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787907066.212282:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787907066.212532:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787907066.212671:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907066.212729:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed82cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787907066.212903:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000384896 00000100:00100000:2.0:1787907066.212913:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000384896 00000100:00100000:2.0:1787907066.212969:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787907066.212979:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15058:x1874756000384896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787907066.213279:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15058:x1874756000384896:12345-0@lo:501:mount.lustre.0 Request processed in 299us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907066.213288:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787907066.213512:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000384896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787907066.213557:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000385024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787907066.214709:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907066.221075:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed82cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787907066.221474:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000385024 00000100:00100000:1.0:1787907066.221489:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000385024 00000100:00100000:1.0:1787907066.221569:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787907066.221580:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15058:x1874756000385024:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787907066.222183:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15058:x1874756000385024:12345-0@lo:503:mount.lustre.0 Request processed in 601us (7474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907066.222203:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787907066.226465:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000385024:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787907066.227898:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787907066.228021:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000385152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787907066.228111:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907066.228189:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000385152 00000100:00100000:3.0:1787907066.228197:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000385152 00000100:00100000:3.0:1787907066.228245:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787907066.228256:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15058:x1874756000385152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787907066.229677:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15058:x1874756000385152:12345-0@lo:502:mount.lustre.0 Request processed in 1412us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907066.229705:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787907066.230546:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52ed82cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787907066.230580:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000385152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787907066.232734:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787907066.234541:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787907066.234593:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787907066.234685:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787907066.234723:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787907066.234782:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787907066.234841:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787907066.234879:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787907066.234930:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787907066.234967:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787907066.235002:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787907066.238117:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787907066.238206:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787907066.238242:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787907066.238292:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787907066.238327:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787907066.238359:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787907066.238407:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787907066.238459:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787907066.238521:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787907066.238573:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787907066.238610:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787907066.238646:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787907066.238697:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787907066.238734:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787907066.239325:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787907066.239401:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787907066.240580:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787907066.240622:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787907066.240683:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787907066.240721:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787907066.240757:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787907066.242146:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787907066.242246:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787907066.242301:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787907066.242370:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787907066.242409:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787907066.242904:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787907066.242957:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787907066.242996:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787907066.243051:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000385280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787907066.243162:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907066.243214:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa53afb06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787907066.243297:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000385280 00000100:00100000:1.0:1787907066.243305:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000385280 00000100:00100000:1.0:1787907066.243358:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787907066.243369:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15058:x1874756000385280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787907066.245664:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15058:x1874756000385280:12345-0@lo:502:mount.lustre.0 Request processed in 2280us (2486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907066.245681:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787907066.246357:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000385280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787907066.246644:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787907066.246660:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787907066.252294:0:15082:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787907066.252319:0:15082:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8aa50ee199b8) 00000020:00000080:0.0:1787907066.252345:0:15082:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787907066.252460:0:15082:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa5131e2000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787907066.252465:0:15082:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa5131e2000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787907066.252468:0:15082:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa5131e2000 3 00010000:00080000:0.0:1787907066.252502:0:15082:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa510326800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1787907066.254186:0:15082:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787907066.260293:0:15082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787907066.262727:0:15082:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787907066.262751:0:15082:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x72bb6cf063cae3ec 00000100:00080000:0.0:1787907066.262764:0:15082:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787907066.262770:0:15082:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8aa510326800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1787907066.262807:0:15082:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa535e8a300 x1874756000385408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787907066.262866:0:15082:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787907066.262900:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787907066.262905:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787907066.262908:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787907066.262912:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787907066.264951:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787907066.264978:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000385536:0@lo:400:kworker.0 00000100:00100000:0.0:1787907066.265066:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907066.265206:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1874756000385408:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787907066.265243:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907066.265303:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000385536 00000100:00100000:3.0:1787907066.265311:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000385536 00000100:00100000:3.0:1787907066.265365:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000385408 00000100:00100000:3.0:1787907066.265369:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000385408 00000100:00100000:3.0:1787907066.265383:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787907066.265393:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000385536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787907066.267206:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000385536:12345-0@lo:400:kworker.0 Request processed in 1804us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907066.267233:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787907066.267267:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787907066.267274:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1874756000385408:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787907066.267299:0:14377:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:3.0:1787907066.267337:0:14377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x72bb6cf063cae3f3 00000004:00100000:3.0:1787907066.267368:0:14377:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787907066.267403:0:14377:0:(import.c:65:import_set_state_nolock()) ffff8aa401355800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787907066.267798:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874756000385408:12345-0@lo:38:llog_process_th.0 Request processed in 522us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907066.267806:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787907066.267868:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8aa535e88700 x1874756000385536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787907066.267885:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000385536:0@lo:400:kworker.0 00000040:00080000:1.0:1787907066.270192:0:15082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787907066.270302:0:15058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787907066.270329:0:15058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787907066.270358:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cae3d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae3de expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907066.270371:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa500031c00/0x72bb6cf063cae3d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae3de expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787907066.270562:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787907066.270564:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787907066.270566:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787907066.270567:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787907066.270569:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787907066.270570:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787907066.270572:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787907066.270574:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787907066.270575:0:15058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787907066.270579:0:15058:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787907066.270581:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787907066.270583:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787907066.270584:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787907066.270585:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787907066.270592:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787907066.270593:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787907066.270594:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787907066.270595:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787907066.270596:0:15058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787907066.270622:0:15058:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787907066.270641:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000385664:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787907066.270709:0:15058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907066.270744:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5082550c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787907066.270852:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000385664 00000100:00100000:3.0:1787907066.270861:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000385664 00000100:00100000:3.0:1787907066.270904:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787907066.270913:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15058:x1874756000385664:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787907066.270939:0:14371:0:(mgs_handler.c:454:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787907066.270955:0:14371:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1787907066.277742:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8aa535e8a300 x1874756000385408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787907076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907066.277758:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787907066.277768:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787907066.277778:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787907066.277784:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787907066.277788:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa510326800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787907066.277796:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1874756000385408:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1787907066.280722:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1787907066.301570:0:14371:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787907066.301593:0:14371:0:(mgs_handler.c:675:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787907066.301689:0:14393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787907066.301693:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787907066.301716:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.301735:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cae367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae360 expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.301742:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.301792:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cae367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cae360 expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.301805:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cae367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cae360 expref: 16 pid: 14371 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907066.301844:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1874756000385792:0@lo:104: 00000100:00100000:2.0:1787907066.301929:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907066.301983:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507ed1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787907066.302324:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000385792 00000100:00100000:3.0:1787907066.302333:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000385792 00000100:00100000:3.0:1787907066.302395:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787907066.302405:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ebba1202-2d0e-4d1e-8963-43f853425a20+3:14393:x1874756000385792:12345-0@lo:104: 00010000:00010000:3.0:1787907066.302419:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cae367 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907066.302493:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787907066.302500:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ebba1202-2d0e-4d1e-8963-43f853425a20+3:14393:x1874756000385792:12345-0@lo:104: Request processed in 97us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907066.302507:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787907066.302640:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907066.302647:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cae367 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.302654:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8ee00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:2.0:1787907066.302659:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cae367 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.302679:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cae367 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787907066.302686:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cae367 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787907066.302691:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787907066.302727:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae367 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.302733:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787907066.302761:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae367 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.302768:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8ee00/0x72bb6cf063cae360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae367 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.302785:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907066.302787:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907066.302788:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787907066.302805:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000385920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787907066.302869:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907066.302921:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000385920 00000100:00100000:2.0:1787907066.302925:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000385920 00010000:00010000:2.0:1787907066.302943:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cae367 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cae360 expref: 17 pid: 14371 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907066.302965:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787907066.302972:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ebba1202-2d0e-4d1e-8963-43f853425a20+17:3303:x1874756000385920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787907066.302989:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787907066.302995:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cae367 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cae360 expref: 17 pid: 14371 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.303005:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cae367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cae360 expref: 17 pid: 14371 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.303021:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.303030:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787907066.303045:0:14363:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005091735s 00010000:00010000:2.0:1787907066.303049:0:14363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.303056:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.303063:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.303070:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.303075:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97600 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907066.303080:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.303087:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.303104:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.303113:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787907066.303160:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ebba1202-2d0e-4d1e-8963-43f853425a20+17:3303:x1874756000385920:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907066.303168:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787907066.303209:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000385920:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787907066.303238:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa541c96800/0x72bb6cf063cae367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cae360 expref: 16 pid: 14371 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907066.303249:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1874756000385792:0@lo:104: 00010000:00010000:2.0:1787907066.303265:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.303274:0:14393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.303281:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907066.303287:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa541c97600/0x72bb6cf063cae3fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907066.312112:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+15:15058:x1874756000385664:12345-0@lo:253:mount.lustre.0 Request processed in 41191us (41394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907066.312136:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787907066.312231:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15058:1874756000385664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787907066.312246:0:15058:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787907066.312250:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787907066.312264:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787907066.312265:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787907066.312266:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787907066.312268:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787907066.312269:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787907066.312270:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787907066.312273:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787907066.312274:0:15058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787907066.312288:0:15058:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787907066.316402:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787907066.316579:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787907066.316743:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787907066.316931:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787907066.317080:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787907066.317314:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787907066.318712:0:15058:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787907066.375084:0:15058:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787907066.375093:0:15058:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787907066.375140:0:15058:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787907066.375203:0:15058:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787907066.375224:0:15058:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787907066.375255:0:15058:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787907067.297953:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787907067.556405:0:14374:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787907067.556416:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8aa52f19c000 from 7 10000000:01000000:2.0:1787907067.556422:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787907067.556482:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907067.556497:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907067.556512:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907067.556548:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000386048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787907067.556671:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907067.556783:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a29d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787907067.559460:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000386048 00000100:00100000:3.0:1787907067.559481:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000386048 00000100:00100000:0.0:1787907067.559614:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787907067.559626:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+15:14374:x1874756000386048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787907067.559653:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907067.559674:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cae408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae401 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907067.559703:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cae408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae401 expref: 16 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907067.559730:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cae408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae401 expref: 16 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907067.559752:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa53ac8f200, rc 0) 00000100:00100000:0.0:1787907067.559871:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+16:14374:x1874756000386048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (3201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907067.559879:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787907067.560119:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000386048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787907067.560144:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae408 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907067.560163:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae408 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907067.560240:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000386176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787907067.560285:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907067.560326:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a29d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787907067.560404:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000386176 00000100:00100000:3.0:1787907067.560411:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000386176 00000100:00100000:3.0:1787907067.560438:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787907067.560447:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+16:14374:x1874756000386176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787907067.560467:0:14369:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787907067.560492:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787907067.560497:0:14369:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787907067.560580:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+16:14374:x1874756000386176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907067.560588:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787907067.560715:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000386176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787907067.560786:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787907067.560794:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae408 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907067.560803:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae408 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907068.325062:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907069.346184:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907070.369682:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907071.392160:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787907071.650908:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787907071.650917:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787907071.650921:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787907071.650924:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787907071.650994:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ebba1202-2d0e-4d1e-8963-43f853425a20:3304:1874756000386304:0@lo:400:kworker.0 00000100:00100000:1.0:1787907071.651107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907071.651177:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000386560:0@lo:400:kworker.0 00000100:00100000:1.0:1787907071.651220:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907071.651243:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787907071.651249:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000386432:0@lo:400:kworker.0 00000100:00100000:1.0:1787907071.651273:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907071.651895:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000386304 00000100:00100000:2.0:1787907071.651908:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000386304 00000100:00100000:2.0:1787907071.651975:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787907071.651987:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+16:3304:x1874756000386304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907071.652069:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+16:3304:x1874756000386304:12345-0@lo:400:kworker.0 Request processed in 85us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907071.652077:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787907071.652137:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ebba1202-2d0e-4d1e-8963-43f853425a20:3304:1874756000386304:0@lo:400:kworker.0 00000100:00100000:1.0:1787907071.653867:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000386560 00000100:00100000:1.0:1787907071.653884:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000386560 00000100:00100000:1.0:1787907071.653975:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000386432 00000100:00100000:1.0:1787907071.653978:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000386432 00000100:00100000:1.0:1787907071.653998:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787907071.654008:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000386560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787907071.654116:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000386560:12345-0@lo:400:kworker.0 Request processed in 107us (2893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907071.654124:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787907071.654140:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787907071.654146:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000386432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787907071.654173:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000386432:12345-0@lo:400:kworker.0 Request processed in 27us (2899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907071.654180:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787907071.654234:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa4037a4e00 x1874756000386432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787907071.654250:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000386432:0@lo:400:kworker.0 00010000:00080000:1.0:1787907071.654263:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa4037a7800 x1874756000386560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787907071.654271:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000386560:0@lo:400:kworker.0 00000100:00080000:2.0:1787907071.655049:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787907072.417924:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907073.441284:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787907073.852913:0:15425:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1787907073.896939:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787907074.474199:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907075.488104:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.512306:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787907076.517084:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787907061/real 1787907061] req@ffff8aa4037a4700 x1874756000382848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787907076 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787907076.517135:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8aa4037a4700 x1874756000382848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787907076 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787907076.517147:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787907061/real 1787907061] req@ffff8aa4037a5c00 x1874756000382720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787907076 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787907076.517159:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8aa4037a5c00 x1874756000382720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787907076 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787907076.517196:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa541c77000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787907076.519408:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787907076.519418:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000382848:0@lo:8:kworker.0 00000100:00080000:3.0:1787907076.519429:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa53b055000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787907076.525723:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787907076.525730:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787907076.525734:0:36:0:(import.c:65:import_set_state_nolock()) ffff8aa53b055000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787907076.525744:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 500 00000100:00080000:0.0:1787907076.525750:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787907076.525758:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8aa53b055000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1787907076.525781:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa535e88000 x1874756000386816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787907076.525792:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787907076.525795:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787907076.525797:0:36:0:(import.c:65:import_set_state_nolock()) ffff8aa541c77000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787907076.525801:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 500 00000100:00080000:0.0:1787907076.525803:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787907076.526229:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8aa541c77000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1787907076.526249:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa535e88a80 x1874756000386944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787907076.526323:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787907076.526427:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000387200:0@lo:400:kworker.0 00000100:00100000:0.0:1787907076.526500:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907076.526705:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000387200 00000100:00100000:0.0:1787907076.526712:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000387200 00000100:00100000:0.0:1787907076.526771:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787907076.526781:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000387200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907076.526985:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000387200:12345-0@lo:400:kworker.0 Request processed in 204us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907076.526992:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787907076.527033:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa535e8b480 x1874756000387200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907076.527048:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000387200:0@lo:400:kworker.0 00000100:00100000:2.0:1787907076.527177:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000386688:0@lo:400:kworker.0 00000100:00100000:2.0:1787907076.527215:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907076.527251:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787907076.527258:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000387072:0@lo:400:kworker.0 00000100:00100000:2.0:1787907076.527283:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787907076.527324:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787907076.527441:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000386688 00000100:00100000:0.0:1787907076.527448:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000386688 00000100:00100000:0.0:1787907076.527487:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787907076.527493:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+16:3303:x1874756000386688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907076.527665:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+16:3303:x1874756000386688:12345-0@lo:400:kworker.0 Request processed in 171us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907076.527672:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787907076.527755:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000386688:0@lo:400:kworker.0 00000100:00100000:2.0:1787907076.528057:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000387072 00000100:00100000:2.0:1787907076.528061:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000387072 00000100:00100000:2.0:1787907076.528126:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787907076.528134:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000387072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907076.528177:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000387072:12345-0@lo:400:kworker.0 Request processed in 44us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907076.528183:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787907076.528234:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787907076.528241:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000382720:0@lo:8:kworker.0 00000100:00100000:3.0:1787907076.528378:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000386816:0@lo:8:kworker.0 00000100:00100000:3.0:1787907076.528416:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907076.528444:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000386944:0@lo:8:kworker.0 00000100:00100000:3.0:1787907076.528469:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787907076.528532:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa535e89f80 x1874756000387072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787907076.528544:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000387072:0@lo:400:kworker.0 00000100:00100000:3.0:1787907076.528587:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000386816 00000100:00100000:3.0:1787907076.528591:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000386816 00000100:00100000:3.0:1787907076.528611:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000386944 00000100:00100000:3.0:1787907076.528613:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000386944 00000100:00100000:3.0:1787907076.528622:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787907076.528628:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1874756000386816:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787907076.528657:0:15060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:3.0:1787907076.528693:0:15060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bb6cf063cae40f 00002000:00100000:3.0:1787907076.528713:0:15060:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8aa401354800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113955 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787907076.528718:0:15060:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787907076.528732:0:15060:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787907076.529221:0:15060:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787907076.529252:0:15060:0:(import.c:65:import_set_state_nolock()) ffff8aa401355000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787907076.529312:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1874756000386816:12345-0@lo:8:kworker.0 Request processed in 681us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907076.529321:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787907076.529345:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787907076.529351:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1874756000386944:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787907076.529365:0:15060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787907076.529394:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1874756000386944:12345-0@lo:8:kworker.0 Request processed in 42us (924us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787907076.529400:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787907076.529440:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa535e88000 x1874756000386816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787907096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787907076.529450:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787907076.529457:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787907076.529467:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787907076.529475:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787907076.529478:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa53b055000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787907076.529497:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787907076.529501:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000386816:0@lo:8:kworker.0 00000004:00080000:3.0:1787907076.529551:0:14400:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787907076.529570:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f789f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1874756000387456:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787907076.529602:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907076.529622:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa518610540 going to sleep for 11 seconds 00000004:00080000:3.0:1787907076.529638:0:14399:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787907076.529965:0:14399:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 514802151149ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787907076.529994:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000387456 00000100:00100000:3.0:1787907076.530000:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000387456 00000100:00100000:3.0:1787907076.530041:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787907076.530048:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14400:x1874756000387456:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787907076.532029:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000387328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787907076.532120:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907076.532199:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000387328 00000100:00100000:0.0:1787907076.532208:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000387328 00000100:00100000:0.0:1787907076.532261:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787907076.532278:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874756000387328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787907076.532321:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787907076.533698:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787907076.533790:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874756000387328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1511us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907076.533801:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787907076.534069:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa53f78b100 x1874756000387328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787907092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907076.534093:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000387328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787907076.534134:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa541c77000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787907076.534140:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787907076.534144:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000386944:0@lo:8:kworker.0 00002000:00080000:3.0:1787907076.537722:0:15061:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787907076.537734:0:15061:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787907076.537739:0:15061:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1787907076.547320:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787907076.547666:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae416 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.547686:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=514s v=(0 0) 00010000:00010000:3.0:1787907076.547690:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787907076.547697:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.547716:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.547727:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.547736:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.547762:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787907076.548258:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787907076.548264:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae41d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548273:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=514s v=(0 0) 00010000:00010000:3.0:1787907076.548276:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787907076.548281:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae41d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548290:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae41d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548298:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae41d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548306:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae41d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548321:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787907076.548456:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787907076.548463:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548470:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907076.548475:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548495:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548635:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae416 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548643:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb8025be/0x72bb6cf063cae416 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548661:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907076.548664:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae41d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548670:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907076.548673:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae41d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548681:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae41d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548690:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae41d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548696:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005baa6b09/0x72bb6cf063cae41d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.548719:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907076.548721:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907076.548723:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.549136:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787907076.549480:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787907076.549487:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cae424 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.549497:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=514s v=(0 0) 00010000:00010000:3.0:1787907076.549501:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787907076.549515:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cae424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.549526:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cae424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.549534:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cae424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.549541:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cae424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.549555:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787907076.549570:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907076.549574:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cae424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.549592:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030200 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907076.549596:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cae424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.549604:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cae424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.549616:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cae424 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.549623:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009de80213/0x72bb6cf063cae424 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.549635:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907076.549636:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907076.549638:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787907076.550199:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787907076.550206:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb37552b/0x72bb6cf063cae42b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.550216:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=514s v=(0 0) 00010000:00010000:3.0:1787907076.550220:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787907076.550224:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb37552b/0x72bb6cf063cae42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.550234:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb37552b/0x72bb6cf063cae42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.550247:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb37552b/0x72bb6cf063cae42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.550254:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb37552b/0x72bb6cf063cae42b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.550268:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787907076.550276:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907076.550281:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb37552b/0x72bb6cf063cae42b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.550288:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031200 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907076.550292:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb37552b/0x72bb6cf063cae42b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.550300:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb37552b/0x72bb6cf063cae42b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.550310:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb37552b/0x72bb6cf063cae42b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.550317:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb37552b/0x72bb6cf063cae42b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.550330:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907076.550337:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907076.550338:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787907076.553288:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787907076.553304:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e5b0d87/0x72bb6cf063cae432 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.553324:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=514s v=(0 0) 00010000:00010000:3.0:1787907076.553568:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787907076.553577:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e5b0d87/0x72bb6cf063cae432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.553593:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e5b0d87/0x72bb6cf063cae432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.553603:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e5b0d87/0x72bb6cf063cae432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.553612:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e5b0d87/0x72bb6cf063cae432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.553631:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787907076.553643:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907076.553648:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e5b0d87/0x72bb6cf063cae432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.553656:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030800 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907076.553661:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e5b0d87/0x72bb6cf063cae432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.553686:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e5b0d87/0x72bb6cf063cae432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.553705:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e5b0d87/0x72bb6cf063cae432 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.553712:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e5b0d87/0x72bb6cf063cae432 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.553732:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907076.553734:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907076.553736:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787907076.555137:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787907076.555146:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae439 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555158:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=514s v=(0 0) 00010000:00010000:3.0:1787907076.555162:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787907076.555167:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555178:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555186:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555199:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555215:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787907076.555226:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907076.555230:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555237:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500030000 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907076.555242:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555250:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555263:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae439 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555270:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d071e261/0x72bb6cf063cae439 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555286:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907076.555287:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907076.555289:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787907076.555703:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787907076.555714:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076fa7bf/0x72bb6cf063cae440 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555723:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=514s v=(0 0) 00010000:00010000:3.0:1787907076.555727:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787907076.555731:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000076fa7bf/0x72bb6cf063cae440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555740:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000076fa7bf/0x72bb6cf063cae440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555749:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076fa7bf/0x72bb6cf063cae440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555757:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000076fa7bf/0x72bb6cf063cae440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.555777:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787907076.556193:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787907076.556199:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cff4570/0x72bb6cf063cae447 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556208:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=514s v=(0 0) 00010000:00010000:3.0:1787907076.556211:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787907076.556215:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cff4570/0x72bb6cf063cae447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556223:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cff4570/0x72bb6cf063cae447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556238:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cff4570/0x72bb6cf063cae447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556246:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cff4570/0x72bb6cf063cae447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556262:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787907076.556273:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787907076.556277:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000076fa7bf/0x72bb6cf063cae440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556283:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511995200 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907076.556287:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000076fa7bf/0x72bb6cf063cae440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556295:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000076fa7bf/0x72bb6cf063cae440 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556306:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000076fa7bf/0x72bb6cf063cae440 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556313:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000076fa7bf/0x72bb6cf063cae440 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556327:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907076.556336:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cff4570/0x72bb6cf063cae447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556343:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511994200 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907076.556346:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cff4570/0x72bb6cf063cae447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556354:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cff4570/0x72bb6cf063cae447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556364:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cff4570/0x72bb6cf063cae447 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556370:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cff4570/0x72bb6cf063cae447 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.556381:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907076.556383:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907076.556384:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.556791:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787907076.557112:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787907076.557119:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d2f5e34/0x72bb6cf063cae44e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.557129:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=514s v=(0 0) 00010000:00010000:3.0:1787907076.557132:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787907076.557136:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d2f5e34/0x72bb6cf063cae44e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.557158:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d2f5e34/0x72bb6cf063cae44e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.557166:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d2f5e34/0x72bb6cf063cae44e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.557172:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d2f5e34/0x72bb6cf063cae44e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.557232:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787907076.557853:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787907076.557859:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3820754/0x72bb6cf063cae455 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.557870:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=514s v=(0 0) 00010000:00010000:3.0:1787907076.557872:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787907076.557876:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3820754/0x72bb6cf063cae455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.557885:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3820754/0x72bb6cf063cae455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.557893:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3820754/0x72bb6cf063cae455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.557913:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3820754/0x72bb6cf063cae455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.558081:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787907076.558088:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d2f5e34/0x72bb6cf063cae44e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.558096:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511995a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907076.558100:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d2f5e34/0x72bb6cf063cae44e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.558108:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d2f5e34/0x72bb6cf063cae44e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.558137:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d2f5e34/0x72bb6cf063cae44e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.558144:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d2f5e34/0x72bb6cf063cae44e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907076.558192:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787907076.558202:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907076.558293:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.558326:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.558327:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787907076.561993:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.562007:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae45c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.562050:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.562056:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.562063:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae45c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.562761:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae45c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.562778:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae45c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.562786:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae45c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.564136:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787907076.564211:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907076.564218:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae45c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.564229:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97c00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907076.564234:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae45c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.564245:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae45c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.564271:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae45c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.564279:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae45c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.564300:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.564302:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.564304:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.564913:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.564922:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3820754/0x72bb6cf063cae455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.564941:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511994c00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907076.564945:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3820754/0x72bb6cf063cae455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.564953:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3820754/0x72bb6cf063cae455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.564967:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3820754/0x72bb6cf063cae455 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.564985:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3820754/0x72bb6cf063cae455 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.565000:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.565002:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.565003:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.565007:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.565008:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787907076.565809:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.565842:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f660350/0x72bb6cf063cae463 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.565855:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.565866:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.565872:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f660350/0x72bb6cf063cae463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.565885:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f660350/0x72bb6cf063cae463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.565895:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f660350/0x72bb6cf063cae463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.565902:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f660350/0x72bb6cf063cae463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.565917:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787907076.565938:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907076.565943:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f660350/0x72bb6cf063cae463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.565950:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97600 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907076.565954:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f660350/0x72bb6cf063cae463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.565961:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f660350/0x72bb6cf063cae463 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.565971:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f660350/0x72bb6cf063cae463 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.565989:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f660350/0x72bb6cf063cae463 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.566002:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.566004:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.566005:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787907076.566956:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.566963:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbe56ec1/0x72bb6cf063cae46a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.566972:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.567170:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.567176:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe56ec1/0x72bb6cf063cae46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.567187:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbe56ec1/0x72bb6cf063cae46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.567195:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbe56ec1/0x72bb6cf063cae46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.567203:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe56ec1/0x72bb6cf063cae46a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.567254:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787907076.567852:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.567864:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004269e1fc/0x72bb6cf063cae471 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.567873:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.567876:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.567880:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004269e1fc/0x72bb6cf063cae471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.567890:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004269e1fc/0x72bb6cf063cae471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.567898:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004269e1fc/0x72bb6cf063cae471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.567904:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004269e1fc/0x72bb6cf063cae471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907076.568017:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787907076.568024:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbe56ec1/0x72bb6cf063cae46a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907076.568032:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96800 already unused, calling callback (ffffffffc1439230) 00010000:00010000:1.0:1787907076.568036:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbe56ec1/0x72bb6cf063cae46a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907076.568045:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbe56ec1/0x72bb6cf063cae46a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907076.568061:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbe56ec1/0x72bb6cf063cae46a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907076.568068:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbe56ec1/0x72bb6cf063cae46a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907076.568171:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787907076.568176:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004269e1fc/0x72bb6cf063cae471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907076.568183:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96400 already unused, calling callback (ffffffffc1439230) 00010000:00010000:1.0:1787907076.568186:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004269e1fc/0x72bb6cf063cae471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907076.568205:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004269e1fc/0x72bb6cf063cae471 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907076.568216:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004269e1fc/0x72bb6cf063cae471 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907076.568223:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907076.568225:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907076.568227:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.568266:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787907076.568271:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004269e1fc/0x72bb6cf063cae471 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907076.568641:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787907076.569307:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.569315:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a26469/0x72bb6cf063cae478 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.569326:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.571120:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.571148:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a26469/0x72bb6cf063cae478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.571170:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a26469/0x72bb6cf063cae478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.571181:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a26469/0x72bb6cf063cae478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.571189:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a26469/0x72bb6cf063cae478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.571206:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787907076.571220:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907076.571225:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a26469/0x72bb6cf063cae478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.571233:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97800 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907076.571238:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a26469/0x72bb6cf063cae478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.571248:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a26469/0x72bb6cf063cae478 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.571266:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a26469/0x72bb6cf063cae478 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.571286:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a26469/0x72bb6cf063cae478 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.571308:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.571311:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.571312:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787907076.572113:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.572127:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e074c48d/0x72bb6cf063cae47f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.572137:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.572141:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.572146:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e074c48d/0x72bb6cf063cae47f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.572157:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e074c48d/0x72bb6cf063cae47f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.572165:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e074c48d/0x72bb6cf063cae47f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.572173:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e074c48d/0x72bb6cf063cae47f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.572189:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787907076.572198:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907076.572208:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e074c48d/0x72bb6cf063cae47f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.572215:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907076.572219:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e074c48d/0x72bb6cf063cae47f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.572227:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e074c48d/0x72bb6cf063cae47f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.572238:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e074c48d/0x72bb6cf063cae47f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.572246:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e074c48d/0x72bb6cf063cae47f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.572260:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.572262:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.572263:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787907076.573784:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.573795:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae486 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.573807:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.573838:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.573844:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.573871:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.573883:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.573892:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.573909:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787907076.574470:0:15545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787907076.574478:0:15545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.574487:0:15545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97c00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907076.574491:0:15545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.574500:0:15545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae486 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.574525:0:15545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae486 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.574533:0:15545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2013327/0x72bb6cf063cae486 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.574549:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.574557:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.574569:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787907076.574727:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.574733:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000818b2386/0x72bb6cf063cae48d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.574742:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.574745:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.574750:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000818b2386/0x72bb6cf063cae48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.574759:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000818b2386/0x72bb6cf063cae48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.574768:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000818b2386/0x72bb6cf063cae48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.574786:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000818b2386/0x72bb6cf063cae48d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.574873:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787907076.576061:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.576070:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e9644d0/0x72bb6cf063cae494 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.576082:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.576085:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.576090:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e9644d0/0x72bb6cf063cae494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.576101:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e9644d0/0x72bb6cf063cae494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.576110:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e9644d0/0x72bb6cf063cae494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.576117:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e9644d0/0x72bb6cf063cae494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.576317:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787907076.576370:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000818b2386/0x72bb6cf063cae48d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.576379:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96000 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907076.576383:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000818b2386/0x72bb6cf063cae48d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.576392:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000818b2386/0x72bb6cf063cae48d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.576406:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000818b2386/0x72bb6cf063cae48d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.576412:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000818b2386/0x72bb6cf063cae48d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.576427:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787907076.576430:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e9644d0/0x72bb6cf063cae494 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.576435:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96e00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907076.576438:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e9644d0/0x72bb6cf063cae494 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.576457:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e9644d0/0x72bb6cf063cae494 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.576467:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e9644d0/0x72bb6cf063cae494 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.576475:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.576477:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.576479:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.576731:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787907076.576737:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e9644d0/0x72bb6cf063cae494 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.576768:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787907076.577280:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.577286:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093bc12d3/0x72bb6cf063cae49b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.577296:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.577299:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.577303:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093bc12d3/0x72bb6cf063cae49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.577313:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093bc12d3/0x72bb6cf063cae49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.577322:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093bc12d3/0x72bb6cf063cae49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.577343:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093bc12d3/0x72bb6cf063cae49b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.577358:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787907076.577807:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.577840:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d118d4d7/0x72bb6cf063cae4a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.577848:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.577851:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.577861:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d118d4d7/0x72bb6cf063cae4a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.577872:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d118d4d7/0x72bb6cf063cae4a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.577881:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d118d4d7/0x72bb6cf063cae4a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.577888:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d118d4d7/0x72bb6cf063cae4a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.577903:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787907076.578317:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.578323:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff03daf7/0x72bb6cf063cae4a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578331:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.578334:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.578338:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff03daf7/0x72bb6cf063cae4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578346:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff03daf7/0x72bb6cf063cae4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578353:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff03daf7/0x72bb6cf063cae4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578370:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff03daf7/0x72bb6cf063cae4a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578383:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787907076.578399:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787907076.578405:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093bc12d3/0x72bb6cf063cae49b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578412:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97e00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907076.578416:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093bc12d3/0x72bb6cf063cae49b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578424:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093bc12d3/0x72bb6cf063cae49b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578439:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093bc12d3/0x72bb6cf063cae49b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578446:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093bc12d3/0x72bb6cf063cae49b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578463:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787907076.578467:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d118d4d7/0x72bb6cf063cae4a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578483:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd0200 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907076.578486:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d118d4d7/0x72bb6cf063cae4a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578493:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d118d4d7/0x72bb6cf063cae4a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578504:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d118d4d7/0x72bb6cf063cae4a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578511:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d118d4d7/0x72bb6cf063cae4a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578524:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907076.578527:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff03daf7/0x72bb6cf063cae4a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578533:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd0800 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907076.578536:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff03daf7/0x72bb6cf063cae4a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578544:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff03daf7/0x72bb6cf063cae4a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578552:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff03daf7/0x72bb6cf063cae4a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578564:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff03daf7/0x72bb6cf063cae4a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.578575:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.578577:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.578579:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.578587:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787907076.579026:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.579032:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059bc2a04/0x72bb6cf063cae4b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.579041:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.579044:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.579048:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059bc2a04/0x72bb6cf063cae4b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.579057:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059bc2a04/0x72bb6cf063cae4b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.579066:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059bc2a04/0x72bb6cf063cae4b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.579073:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059bc2a04/0x72bb6cf063cae4b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.579085:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787907076.579100:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907076.579104:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059bc2a04/0x72bb6cf063cae4b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.579111:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd1600 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907076.579115:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059bc2a04/0x72bb6cf063cae4b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.579123:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059bc2a04/0x72bb6cf063cae4b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.579133:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059bc2a04/0x72bb6cf063cae4b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.579141:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059bc2a04/0x72bb6cf063cae4b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.579155:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.579157:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.579159:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787907076.579571:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.579577:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee2dbed9/0x72bb6cf063cae4b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.579585:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=514s v=(0 0) 00010000:00010000:0.0:1787907076.580131:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.580226:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.580232:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee2dbed9/0x72bb6cf063cae4b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.580256:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee2dbed9/0x72bb6cf063cae4b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.580266:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee2dbed9/0x72bb6cf063cae4b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.580274:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee2dbed9/0x72bb6cf063cae4b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.580463:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787907076.581008:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.581015:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee05a797/0x72bb6cf063cae4be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.581026:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.581030:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.581034:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee05a797/0x72bb6cf063cae4be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.581044:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee05a797/0x72bb6cf063cae4be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.581053:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee05a797/0x72bb6cf063cae4be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.581072:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee05a797/0x72bb6cf063cae4be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.581210:0:15545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787907076.581217:0:15545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee2dbed9/0x72bb6cf063cae4b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.581225:0:15545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd1200 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907076.581229:0:15545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee2dbed9/0x72bb6cf063cae4b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.581237:0:15545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee2dbed9/0x72bb6cf063cae4b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.581253:0:15545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee2dbed9/0x72bb6cf063cae4b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.581260:0:15545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee2dbed9/0x72bb6cf063cae4b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.581317:0:15545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787907076.581321:0:15545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee05a797/0x72bb6cf063cae4be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.581328:0:15545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd0400 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907076.581414:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787907076.581425:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.581564:0:15545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee05a797/0x72bb6cf063cae4be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.581573:0:15545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee05a797/0x72bb6cf063cae4be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.581584:0:15545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee05a797/0x72bb6cf063cae4be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.581590:0:15545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee05a797/0x72bb6cf063cae4be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.581602:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.581604:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.581606:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787907076.582109:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.582115:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000330612d6/0x72bb6cf063cae4c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.582125:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.582129:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.582134:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000330612d6/0x72bb6cf063cae4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.582144:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000330612d6/0x72bb6cf063cae4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.582152:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000330612d6/0x72bb6cf063cae4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.582159:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000330612d6/0x72bb6cf063cae4c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.582216:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787907076.583503:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.583644:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d47d7e6/0x72bb6cf063cae4cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.583660:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.583664:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.583669:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d47d7e6/0x72bb6cf063cae4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.583682:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d47d7e6/0x72bb6cf063cae4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.583692:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d47d7e6/0x72bb6cf063cae4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.583700:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d47d7e6/0x72bb6cf063cae4cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.584090:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787907076.584098:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000330612d6/0x72bb6cf063cae4c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.584107:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd1a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907076.584117:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000330612d6/0x72bb6cf063cae4c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.584127:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000330612d6/0x72bb6cf063cae4c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.584146:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000330612d6/0x72bb6cf063cae4c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.584154:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000330612d6/0x72bb6cf063cae4c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.584288:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787907076.584293:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d47d7e6/0x72bb6cf063cae4cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.584299:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd0a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907076.584303:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d47d7e6/0x72bb6cf063cae4cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.584310:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d47d7e6/0x72bb6cf063cae4cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.584320:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d47d7e6/0x72bb6cf063cae4cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.584740:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.584748:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907076.584750:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907076.585119:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787907076.585127:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d47d7e6/0x72bb6cf063cae4cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787907076.585160:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787907076.586066:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787907076.586076:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000308cbf2f/0x72bb6cf063cae4d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.586088:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1787907076.586092:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907076.586104:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000308cbf2f/0x72bb6cf063cae4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.586117:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000308cbf2f/0x72bb6cf063cae4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.586127:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000308cbf2f/0x72bb6cf063cae4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.586134:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000308cbf2f/0x72bb6cf063cae4d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.586320:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787907076.586327:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000308cbf2f/0x72bb6cf063cae4d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.586402:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd1000 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907076.586408:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000308cbf2f/0x72bb6cf063cae4d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.586417:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000308cbf2f/0x72bb6cf063cae4d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907076.586433:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000308cbf2f/0x72bb6cf063cae4d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907076.586627:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787907076.586633:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000308cbf2f/0x72bb6cf063cae4d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787907076.586889:0:15061:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1787907076.587014:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14400:x1874756000387456:12345-0@lo:5:osp-pre-0-0.0 Request processed in 56961us (57406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907076.587028:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787907076.587119:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907076.587152:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907076.587154:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907076.587155:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787907076.587323:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f789f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1874756000387456:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787907076.587345:0:14400:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787907076.587405:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f789f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1874756000387584:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787907076.587525:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907076.587600:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa518610540 going to sleep for 11 seconds 00000100:00100000:3.0:1787907076.587805:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000387584 00000100:00100000:3.0:1787907076.588033:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000387584 00000100:00100000:3.0:1787907076.588119:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787907076.588129:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14400:x1874756000387584:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787907076.588173:0:15062:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1787907076.603534:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14400:x1874756000387584:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15399us (16001us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787907076.603548:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787907076.603560:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f789f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1874756000387584:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787907076.603576:0:14400:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00080000:0.0:1787907076.957720:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787907076.957796:0:6699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787907077.537993:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907078.562948:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907079.586943:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907080.608607:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907081.639334:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787907081.890867:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787907081.890874:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787907081.890878:0:36:0:(import.c:65:import_set_state_nolock()) ffff8aa541c77000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787907081.890888:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:0.0:1787907081.890896:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787907081.890913:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8aa541c77000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1787907081.890937:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa535e8aa00 x1874756000387968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787907081.891043:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000387712:0@lo:400:kworker.0 00000100:00100000:0.0:1787907081.891133:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907081.891180:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000388352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787907081.891208:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907081.891232:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787907081.891237:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000387840:0@lo:400:kworker.0 00000100:00100000:0.0:1787907081.891258:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907081.891281:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000387968:0@lo:8:kworker.0 00000100:00100000:0.0:1787907081.891302:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907081.891326:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000388224:0@lo:400:kworker.0 00000100:00100000:0.0:1787907081.891350:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907081.891368:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787907081.891373:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000388096:0@lo:400:kworker.0 00000100:00100000:0.0:1787907081.891394:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907081.891443:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000387840 00000100:00100000:0.0:1787907081.891451:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000387840 00000100:00100000:0.0:1787907081.891500:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000387968 00000100:00100000:0.0:1787907081.891503:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000387968 00000100:00100000:0.0:1787907081.891519:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787907081.891531:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000387840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907081.891584:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000387840:12345-0@lo:400:kworker.0 Request processed in 56us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907081.891591:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787907081.891619:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787907081.891624:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1874756000387968:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787907081.891641:0:15060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787907081.893748:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000388352 00000100:00100000:1.0:1787907081.893764:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000388352 00000100:00100000:1.0:1787907081.893862:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787907081.893873:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000388352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787907081.893914:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787907081.893992:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000388352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907081.893998:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787907081.894375:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000387712 00000100:00100000:2.0:1787907081.894380:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000387712 00000100:00100000:2.0:1787907081.894414:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787907081.894421:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+16:3303:x1874756000387712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907081.894491:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+16:3303:x1874756000387712:12345-0@lo:400:kworker.0 Request processed in 70us (3358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907081.894497:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787907081.894537:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787907081.897660:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000388224 00000100:00100000:2.0:1787907081.897680:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000388224 00000100:00100000:2.0:1787907081.897748:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000388096 00000100:00100000:2.0:1787907081.897752:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000388096 00000100:00100000:2.0:1787907081.897772:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787907081.897781:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000388224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907081.898196:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000388224:12345-0@lo:400:kworker.0 Request processed in 414us (6843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907081.898204:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787907081.898226:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787907081.898233:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000388096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907081.898265:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000388096:12345-0@lo:400:kworker.0 Request processed in 33us (6869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907081.898271:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787907081.898296:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787907081.900548:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa535e8b100 x1874756000388096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787907081.900595:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000388096:0@lo:400:kworker.0 00010000:00080000:1.0:1787907081.900616:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa535e89880 x1874756000388224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787907081.900626:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000388224:0@lo:400:kworker.0 00000100:00100000:2.0:1787907081.901066:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787907081.902411:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000387840:0@lo:400:kworker.0 00000100:00100000:2.0:1787907081.902440:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000387712:0@lo:400:kworker.0 00000100:00100000:2.0:1787907081.902463:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000388352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787907081.928804:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1874756000387968:12345-0@lo:8:kworker.0 Request processed in 37168us (37490us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787907081.931642:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787907081.931712:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa541c77000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787907081.931718:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787907081.931722:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000387968:0@lo:8:kworker.0 00000020:01000004:2.0:1787907081.941190:0:15777:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787907081.941194:0:15777:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787907081.941309:0:15777:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8aa51a7e0800 00000020:01000004:2.0:1787907081.941336:0:15777:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787907081.941349:0:15777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787907081.941363:0:15777:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8aa52ebc4d28) 00000020:00000080:2.0:1787907081.941379:0:15777:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787907081.963788:0:15777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787907081.964307:0:15777:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787907081.965051:0:15777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787907081.965330:0:15777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787907081.965627:0:15777:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787907081.967019:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 641: rc = 0 00100000:10000000:3.0:1787907081.967195:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 641: rc = 0 00100000:10000000:3.0:1787907081.967359:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 641: rc = 0 00100000:10000000:3.0:1787907081.968303:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 782: rc = 0 00100000:10000000:3.0:1787907081.968757:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 782: rc = 0 00100000:10000000:3.0:1787907081.969239:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 782: rc = 0 00100000:10000000:3.0:1787907081.971807:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 782: rc = 0 00100000:10000000:2.0:1787907081.974060:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 782: rc = 0 00100000:10000000:2.0:1787907081.974592:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 782: rc = 0 00000020:00000080:2.0:1787907081.975555:0:15777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787907081.975576:0:15777:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787907081.975592:0:15777:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72bb6cf063cae4e1 00000020:01000004:2.0:1787907081.975603:0:15777:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787907081.975635:0:15777:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787907081.975640:0:15777:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787907081.975646:0:15777:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787907081.975675:0:15777:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787907081.975682:0:15777:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787907081.993065:0:15777:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787907081.993192:0:15777:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.120@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787907081.993196:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787907081.993198:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787907081.993200:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787907081.993201:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787907081.993203:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787907081.993204:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787907081.993206:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787907081.993208:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787907081.993209:0:15777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787907081.993213:0:15777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787907081.993215:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787907081.993217:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787907081.993218:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787907081.993219:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787907081.993220:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787907081.993221:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787907081.993222:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787907081.993223:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787907081.993229:0:15777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787907081.993254:0:15777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787907081.993275:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000388480:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787907081.993356:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907081.993482:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50723f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787907081.994313:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000388480 00000100:00100000:0.0:1787907081.994323:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000388480 00000100:00100000:0.0:1787907081.994416:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787907081.994428:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15777:x1874756000388480:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787907081.994476:0:14369:0:(mgs_handler.c:480:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787907081.994481:0:14369:0:(mgs_handler.c:538:mgs_target_reg()) Checking nodemap for target registration lustre-OST0001 20000000:01000000:0.0:1787907081.994484:0:14369:0:(mgs_handler.c:544:mgs_target_reg()) lustre-OST0001: Nodemap subsystem disabled, allowing target registration 20000000:01000000:0.0:1787907081.994488:0:14369:0:(mgs_handler.c:567:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787907081.994492:0:14369:0:(mgs_handler.c:675:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787907082.029809:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15777:x1874756000388480:12345-0@lo:253:mount.lustre.0 Request processed in 35369us (36438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907082.029853:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787907082.030290:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000388480:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787907082.030307:0:15777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787907082.030311:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787907082.030312:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787907082.030314:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787907082.030315:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787907082.030316:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787907082.030318:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787907082.030319:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787907082.030321:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787907082.030323:0:15777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787907082.030347:0:15777:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8aa51a7e0800 from lustre-OST0001 10000000:01000000:2.0:1787907082.030374:0:15777:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787907082.030377:0:15777:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787907082.030384:0:15777:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8aa5187ccd28 local copy 00010000:00010000:2.0:1787907082.030396:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e800/0x72bb6cf063cae287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae28e expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907082.030742:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000388608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787907082.031205:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907082.031332:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa50723f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787907082.031391:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000388608 00000100:00100000:3.0:1787907082.031400:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000388608 00000100:00100000:3.0:1787907082.031551:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787907082.031563:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15777:x1874756000388608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787907082.032650:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15777:x1874756000388608:12345-0@lo:501:mount.lustre.0 Request processed in 1084us (1440us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787907082.032663:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787907082.032763:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000388608:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787907082.032784:0:15777:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787907082.033003:0:15777:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787907082.033015:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e800/0x72bb6cf063cae287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae28e expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907082.033027:0:15777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e800/0x72bb6cf063cae287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae28e expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787907082.033064:0:15777:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8aa51a7e0800 10000000:01000000:0.0:1787907082.033069:0:15777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787907082.033087:0:15777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787907082.033090:0:15777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787907082.033094:0:15777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787907082.033096:0:15777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787907082.033127:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e200/0x72bb6cf063cae4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907082.033136:0:15777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e200/0x72bb6cf063cae4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907082.033146:0:15777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e200/0x72bb6cf063cae4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907082.033166:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000388736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787907082.033200:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907082.033785:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5218fd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787907082.034250:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000388736 00000100:00100000:2.0:1787907082.034259:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000388736 00000100:00100000:2.0:1787907082.034312:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787907082.034322:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+16:15777:x1874756000388736:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787907082.034338:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907082.034372:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa50efd0e00/0x72bb6cf063cae4ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae4e8 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907082.034403:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa50efd0e00/0x72bb6cf063cae4ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae4e8 expref: 17 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907082.034416:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa50efd0e00/0x72bb6cf063cae4ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae4e8 expref: 17 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907082.034425:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd0e00, rc 0) 00000100:00100000:2.0:1787907082.034493:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+17:15777:x1874756000388736:12345-0@lo:101:mount.lustre.0 Request processed in 172us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907082.034500:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787907082.034923:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000388736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787907082.034941:0:15777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e200/0x72bb6cf063cae4e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae4ef expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907082.034951:0:15777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e200/0x72bb6cf063cae4e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae4ef expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787907082.036194:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787907082.040845:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787907082.042325:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787907082.042415:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787907082.042453:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787907082.042520:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787907082.042560:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787907082.042596:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787907082.042674:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787907082.042684:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787907082.042807:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000388864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787907082.042931:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907082.042971:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5218fd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787907082.043418:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000388864 00000100:00100000:2.0:1787907082.043427:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000388864 00000100:00100000:2.0:1787907082.043490:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787907082.043502:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+17:15777:x1874756000388864:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787907082.044336:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+17:15777:x1874756000388864:12345-0@lo:501:mount.lustre.0 Request processed in 834us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907082.044346:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787907082.044702:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000388864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787907082.044758:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000388992:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787907082.045376:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907082.045425:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5218fd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787907082.046402:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000388992 00000100:00100000:3.0:1787907082.046412:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000388992 00000100:00100000:3.0:1787907082.046493:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787907082.046506:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+17:15777:x1874756000388992:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787907082.048540:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+17:15777:x1874756000388992:12345-0@lo:503:mount.lustre.0 Request processed in 2028us (3156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907082.048554:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787907082.048858:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000388992:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787907082.049694:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787907082.049779:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000389120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787907082.049878:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907082.049924:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5083b2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787907082.050006:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000389120 00000100:00100000:2.0:1787907082.050013:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000389120 00000100:00100000:2.0:1787907082.050057:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787907082.050066:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+17:15777:x1874756000389120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787907082.050482:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+17:15777:x1874756000389120:12345-0@lo:502:mount.lustre.0 Request processed in 416us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907082.050489:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787907082.051426:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000389120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787907082.051694:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787907082.051752:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787907082.051787:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787907082.051874:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787907082.051914:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787907082.051945:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787907082.052031:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787907082.055422:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787907082.055588:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787907082.055658:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000389248:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787907082.055768:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907082.056113:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000389248 00000100:00100000:2.0:1787907082.056130:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000389248 00000100:00100000:2.0:1787907082.056201:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787907082.056216:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+17:15777:x1874756000389248:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787907082.056462:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+17:15777:x1874756000389248:12345-0@lo:502:mount.lustre.0 Request processed in 249us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907082.056471:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787907082.057395:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5083b2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787907082.057427:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000389248:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787907082.057560:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787907082.057579:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787907082.059020:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787907082.059030:0:15778:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787907082.059036:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787907082.059039:0:15778:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787907082.059043:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787907082.059058:0:15778:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8aa50ee18000) 00000020:00000080:0.0:1787907082.059090:0:15778:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787907082.059096:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787907082.059156:0:15778:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa51a7e0800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787907082.059164:0:15778:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787907082.059170:0:15778:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72bb6cf063cae4fd 00010000:00010000:0.0:1787907082.066363:0:15778:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1787907082.067333:0:15778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787907082.079787:0:15778:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787907082.097247:0:15778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787907082.097262:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787907082.097269:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787907082.097271:0:15778:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787907082.097277:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787907082.097281:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787907082.097289:0:15778:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787907082.097293:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787907082.097295:0:15778:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787907082.097299:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787907082.097301:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787907082.097302:0:15778:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787907082.097305:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787907082.097308:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787907082.097309:0:15778:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787907082.097312:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787907082.097381:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787907082.097385:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787907082.097386:0:15778:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787907082.097389:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787907082.101418:0:15777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787907082.101474:0:15777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787907082.101498:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e200/0x72bb6cf063cae4e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae4ef expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907082.101509:0:15777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa53ac8e200/0x72bb6cf063cae4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae4ef expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787907082.101518:0:15777:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa51a7e0800 from 1 10000000:01000000:2.0:1787907082.101521:0:15777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787907082.101562:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907082.101571:0:15777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907082.101583:0:15777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907082.101612:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000389376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787907082.101702:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907082.101742:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5207709c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787907082.102449:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000389376 00000100:00100000:1.0:1787907082.102470:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000389376 00000100:00100000:1.0:1787907082.102542:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787907082.102554:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+17:15777:x1874756000389376:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787907082.102574:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907082.102597:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa508210600/0x72bb6cf063cae50b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae504 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.102629:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508210600/0x72bb6cf063cae50b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae504 expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.102640:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa508210600/0x72bb6cf063cae50b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae504 expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.102652:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508210600, rc 0) 00000100:00100000:1.0:1787907082.102724:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+18:15777:x1874756000389376:12345-0@lo:101:mount.lustre.0 Request processed in 171us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907082.102733:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787907082.103404:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000389376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787907082.103426:0:15777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae50b expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907082.103437:0:15777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae50b expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787907082.107666:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787907082.112486:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787907082.112794:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787907082.112883:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787907082.112948:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787907082.112957:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787907082.113062:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000389504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787907082.113133:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907082.113178:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5207709c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787907082.113660:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000389504 00000100:00100000:3.0:1787907082.113672:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000389504 00000100:00100000:3.0:1787907082.113723:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787907082.113733:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+18:15777:x1874756000389504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787907082.114033:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+18:15777:x1874756000389504:12345-0@lo:501:mount.lustre.0 Request processed in 300us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907082.114041:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787907082.114488:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000389504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787907082.114534:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000389632:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787907082.114582:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907082.114626:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5207709c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787907082.115849:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000389632 00000100:00100000:3.0:1787907082.115860:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000389632 00000100:00100000:3.0:1787907082.115920:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787907082.115929:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+18:15777:x1874756000389632:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787907082.116454:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+18:15777:x1874756000389632:12345-0@lo:503:mount.lustre.0 Request processed in 525us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907082.116464:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787907082.116631:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000389632:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787907082.117609:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787907082.117704:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000389760:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787907082.117791:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907082.118315:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000389760 00000100:00100000:1.0:1787907082.118323:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000389760 00000100:00100000:1.0:1787907082.118365:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787907082.118374:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+18:15777:x1874756000389760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787907082.118608:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+18:15777:x1874756000389760:12345-0@lo:502:mount.lustre.0 Request processed in 234us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907082.118616:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787907082.118674:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507205900 going to sleep for 11 seconds 00000100:00100000:1.0:1787907082.118694:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000389760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787907082.123187:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787907082.123413:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787907082.123457:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787907082.123491:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787907082.123519:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787907082.123559:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787907082.123587:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787907082.123636:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787907082.123691:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000389888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787907082.123780:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907082.124251:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000389888 00000100:00100000:0.0:1787907082.124259:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000389888 00000100:00100000:0.0:1787907082.124317:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787907082.124326:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+18:15777:x1874756000389888:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787907082.124570:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+18:15777:x1874756000389888:12345-0@lo:502:mount.lustre.0 Request processed in 244us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907082.124579:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787907082.125583:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507205900 going to sleep for 11 seconds 00000100:00100000:1.0:1787907082.125617:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000389888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787907082.125784:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787907082.125797:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787907082.129065:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787907082.129190:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907082.129398:0:15782:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787907082.129408:0:15782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa51a7e0800 00000020:00000080:2.0:1787907082.129411:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787907082.129420:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787907082.129422:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907082.129424:0:15782:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787907082.129426:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787907082.129442:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907082.129444:0:15782:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787907082.129447:0:15782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa51a7e0800 00000020:00000080:2.0:1787907082.129449:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787907082.129623:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787907082.129627:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907082.129630:0:15782:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787907082.129632:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787907082.129635:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907082.129637:0:15782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787907082.129640:0:15782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8aa51a7e0800 00000020:00000080:2.0:1787907082.129643:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787907082.132708:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787907082.132723:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787907082.132725:0:15782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787907082.132729:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787907082.141155:0:15777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787907082.141210:0:15777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787907082.141246:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae50b expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907082.141259:0:15777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae50b expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787907082.141311:0:15777:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787907082.141313:0:15777:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8aa51a7e0800 10000000:01000000:3.0:1787907082.141316:0:15777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8aa51a7e0800 10000000:01000000:3.0:1787907082.141320:0:15777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787907082.141326:0:15777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8aa51a7e0800 from 1 10000000:01000000:3.0:1787907082.141329:0:15777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787907082.141363:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511994200/0x72bb6cf063cae512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907082.141372:0:15777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa511994200/0x72bb6cf063cae512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907082.141383:0:15777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa511994200/0x72bb6cf063cae512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907082.141408:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000390016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787907082.141585:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907082.146625:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa501668000 going to sleep for 11 seconds 00000100:00100000:1.0:1787907082.146693:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000390016 00000100:00100000:1.0:1787907082.146704:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000390016 00000100:00100000:1.0:1787907082.146803:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787907082.146848:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+18:15777:x1874756000390016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787907082.146876:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907082.146910:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa508211000/0x72bb6cf063cae519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae512 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.146941:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa508211000/0x72bb6cf063cae519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae512 expref: 19 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.146952:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa508211000/0x72bb6cf063cae519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae512 expref: 19 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.146961:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa508211000, rc 0) 00000100:00100000:1.0:1787907082.147027:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+19:15777:x1874756000390016:12345-0@lo:101:mount.lustre.0 Request processed in 215us (5443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907082.147034:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787907082.147145:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000390016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787907082.147163:0:15777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa511994200/0x72bb6cf063cae512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae519 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907082.147172:0:15777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa511994200/0x72bb6cf063cae512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae519 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787907082.147846:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787907082.148313:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787907082.148561:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787907082.148607:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787907082.148640:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787907082.148686:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787907082.148723:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787907082.148772:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787907082.148860:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787907082.148901:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787907082.148990:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787907082.149062:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787907082.149116:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787907082.149190:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787907082.149228:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787907082.149265:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787907082.149312:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787907082.149357:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787907082.149397:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787907082.149460:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787907082.149500:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787907082.149535:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787907082.150304:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787907082.150355:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787907082.150402:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787907082.150526:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787907082.150570:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787907082.150733:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787907082.150806:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787907082.153265:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787907082.153312:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787907082.155605:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787907082.155774:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787907082.155847:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787907082.155900:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787907082.155965:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787907082.156002:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787907082.156052:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787907082.156361:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787907082.156570:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787907082.156580:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787907082.156786:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000390144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787907082.157225:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907082.157296:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000390144 00000100:00100000:3.0:1787907082.157305:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000390144 00000100:00100000:3.0:1787907082.157367:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787907082.157377:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+19:15777:x1874756000390144:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787907082.159050:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+19:15777:x1874756000390144:12345-0@lo:501:mount.lustre.0 Request processed in 1668us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907082.159062:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787907082.160062:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa501668000 going to sleep for 11 seconds 00000100:00100000:3.0:1787907082.160614:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000390144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787907082.160977:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000390272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787907082.161047:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907082.161095:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000390272 00000100:00100000:2.0:1787907082.161103:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000390272 00000100:00100000:2.0:1787907082.161149:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787907082.161159:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+19:15777:x1874756000390272:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787907082.161356:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa501668000 going to sleep for 11 seconds 00000100:00100000:2.0:1787907082.161592:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+19:15777:x1874756000390272:12345-0@lo:503:mount.lustre.0 Request processed in 433us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907082.161601:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787907082.161770:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000390272:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787907082.163177:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787907082.163273:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000390400:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787907082.163341:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907082.163382:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa51a45be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787907082.163514:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000390400 00000100:00100000:0.0:1787907082.163530:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000390400 00000100:00100000:0.0:1787907082.163576:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787907082.163586:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+19:15777:x1874756000390400:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787907082.164303:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+19:15777:x1874756000390400:12345-0@lo:502:mount.lustre.0 Request processed in 715us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907082.164315:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787907082.166366:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000390400:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787907082.166844:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787907082.166926:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787907082.167336:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787907082.167403:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787907082.167445:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787907082.167495:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787907082.167532:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787907082.167565:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787907082.167642:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787907082.168358:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787907082.168409:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787907082.168463:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787907082.168501:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787907082.168535:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787907082.168584:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787907082.168622:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787907082.168656:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787907082.168788:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787907082.168882:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787907082.168922:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787907082.169209:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787907082.169252:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787907082.169289:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787907082.169337:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787907082.169372:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787907082.169401:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787907082.169456:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787907082.169495:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787907082.169544:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787907082.169600:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787907082.169640:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787907082.169750:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787907082.169843:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787907082.169905:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787907082.170176:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787907082.170251:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787907082.170290:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787907082.170327:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787907082.170392:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787907082.170433:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787907082.170496:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000390528:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787907082.170597:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907082.170666:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa51a45be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787907082.170683:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000390528 00000100:00100000:2.0:1787907082.170694:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000390528 00000100:00100000:2.0:1787907082.170768:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787907082.170779:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+19:15777:x1874756000390528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787907082.171075:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+19:15777:x1874756000390528:12345-0@lo:502:mount.lustre.0 Request processed in 296us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907082.171085:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787907082.171118:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000390528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787907082.171193:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787907082.171203:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787907082.172630:0:15787:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787907082.172646:0:15787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8aa5073919b8) 00000020:00000080:3.0:1787907082.172734:0:15787:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787907082.172865:0:15787:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa51a7e0800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787907082.172869:0:15787:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa51a7e0800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787907082.172873:0:15787:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa51a7e0800 3 00010000:00080000:3.0:1787907082.172912:0:15787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa402734000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1787907082.175211:0:15787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787907082.175453:0:15787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787907082.175490:0:15787:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787907082.175505:0:15787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x72bb6cf063cae527 00000100:00080000:2.0:1787907082.175516:0:15787:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787907082.175521:0:15787:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8aa402734000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1787907082.175557:0:15787:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa53495df80 x1874756000390656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787907082.175583:0:15787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787907082.176106:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1874756000390656:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787907082.176184:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907082.176835:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000390656 00000100:00100000:2.0:1787907082.176847:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000390656 00000100:00100000:2.0:1787907082.176888:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787907082.176897:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3300:x1874756000390656:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787907082.176923:0:14378:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:2.0:1787907082.176957:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x72bb6cf063cae52e 00000004:00100000:2.0:1787907082.176973:0:14378:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787907082.177006:0:14378:0:(import.c:65:import_set_state_nolock()) ffff8aa402ce5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787907082.177075:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874756000390656:12345-0@lo:38:llog_process_th.0 Request processed in 177us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907082.177082:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787907082.177691:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa53495df80 x1874756000390656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787907092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787907082.177716:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787907082.177725:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787907082.177734:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787907082.177739:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787907082.177741:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa402734000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787907082.177748:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1874756000390656:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787907082.178124:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787907082.179418:0:15777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787907082.179453:0:15777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787907082.179473:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511994200/0x72bb6cf063cae512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae519 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907082.179486:0:15777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa511994200/0x72bb6cf063cae512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae519 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787907082.179685:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787907082.179688:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787907082.179689:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787907082.179690:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787907082.179692:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787907082.179693:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787907082.179695:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787907082.179698:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787907082.179699:0:15777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787907082.179704:0:15777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787907082.179706:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787907082.179708:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787907082.179709:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787907082.179710:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787907082.179712:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787907082.179713:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787907082.179714:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787907082.179715:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787907082.179716:0:15777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787907082.179743:0:15777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787907082.179770:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000390784:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787907082.180867:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907082.180931:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5344a6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787907082.181893:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000390784 00000100:00100000:1.0:1787907082.181909:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000390784 00000100:00100000:1.0:1787907082.181975:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787907082.181996:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+19:15777:x1874756000390784:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787907082.182035:0:14372:0:(mgs_handler.c:454:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787907082.182053:0:14372:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787907082.239348:0:14372:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787907082.239374:0:14372:0:(mgs_handler.c:675:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787907082.239438:0:14393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787907082.239445:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787907082.239529:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907082.239552:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cae408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae401 expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907082.239561:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907082.239618:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cae408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cae401 expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907082.239635:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cae408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cae401 expref: 19 pid: 14372 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907082.239652:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1874756000390912:0@lo:104: 00000100:00100000:0.0:1787907082.239732:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907082.239855:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa507ce1000 going to sleep for 11 seconds 00000100:00100000:2.0:1787907082.243887:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000390912 00000100:00100000:2.0:1787907082.243903:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000390912 00000100:00100000:2.0:1787907082.243955:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787907082.243967:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ebba1202-2d0e-4d1e-8963-43f853425a20+3:14393:x1874756000390912:12345-0@lo:104: 00010000:00010000:2.0:1787907082.243994:0:14360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cae408 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907082.244333:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787907082.244360:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ebba1202-2d0e-4d1e-8963-43f853425a20+3:14393:x1874756000390912:12345-0@lo:104: Request processed in 396us (4627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907082.244368:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787907082.244436:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787907082.244444:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cae408 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.244452:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c97400 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:1.0:1787907082.244468:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cae408 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.244479:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cae408 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787907082.244495:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cae408 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787907082.244502:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787907082.244554:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae408 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.244561:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787907082.244580:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae408 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.244587:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa541c97400/0x72bb6cf063cae401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae408 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.244610:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907082.244612:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907082.244614:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787907082.244681:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ebba1202-2d0e-4d1e-8963-43f853425a20:3304:1874756000391040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787907082.244729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907082.244880:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000391040 00000100:00100000:1.0:1787907082.244887:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000391040 00010000:00010000:1.0:1787907082.244913:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cae408 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cae401 expref: 20 pid: 14372 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907082.244934:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787907082.244941:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ebba1202-2d0e-4d1e-8963-43f853425a20+20:3304:x1874756000391040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787907082.244952:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787907082.244957:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cae408 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cae401 expref: 20 pid: 14372 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.244968:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cae408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cae401 expref: 20 pid: 14372 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.244993:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.245002:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787907082.245018:0:14363:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005573884s 00010000:00010000:1.0:1787907082.245022:0:14363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.245030:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.245037:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.245042:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.245047:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8ee00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:1.0:1787907082.245051:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.245059:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.245067:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907082.245079:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787907082.245131:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ebba1202-2d0e-4d1e-8963-43f853425a20+20:3304:x1874756000391040:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907082.245144:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787907082.245540:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ebba1202-2d0e-4d1e-8963-43f853425a20:3304:1874756000391040:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787907082.247420:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa53ac8f200/0x72bb6cf063cae408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cae401 expref: 19 pid: 14372 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907082.247444:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1874756000390912:0@lo:104: 00010000:00010000:3.0:1787907082.247479:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907082.247748:0:14393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907082.247758:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907082.247764:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa53ac8ee00/0x72bb6cf063cae535 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907082.250408:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+18:15777:x1874756000390784:12345-0@lo:253:mount.lustre.0 Request processed in 68417us (69539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907082.250422:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787907082.250580:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ebba1202-2d0e-4d1e-8963-43f853425a20:15777:1874756000390784:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787907082.250595:0:15777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787907082.250598:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787907082.250610:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787907082.250611:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787907082.250613:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787907082.250614:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787907082.250615:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787907082.250617:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787907082.250619:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787907082.250620:0:15777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787907082.250633:0:15777:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787907082.255786:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787907082.258118:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787907082.258318:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787907082.262357:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787907082.263292:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787907082.265759:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787907082.267533:0:15777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787907082.332587:0:15777:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787907082.332601:0:15777:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787907082.332645:0:15777:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787907082.332740:0:15777:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787907082.332760:0:15777:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787907082.332803:0:15777:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787907082.657371:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787907083.105779:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1787907083.551942:0:14374:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787907083.551967:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8aa52f19c000 from 8 10000000:01000000:2.0:1787907083.551974:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787907083.552052:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0600/0x72bb6cf063cae53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907083.552069:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0600/0x72bb6cf063cae53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907083.552084:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0600/0x72bb6cf063cae53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907083.552119:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000391168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787907083.552257:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907083.552336:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5083b2300 going to sleep for 11 seconds 00000100:00100000:3.0:1787907083.552460:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000391168 00000100:00100000:3.0:1787907083.552472:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000391168 00000100:00100000:3.0:1787907083.552558:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787907083.552571:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+18:14374:x1874756000391168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787907083.552593:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787907083.552613:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa511995200/0x72bb6cf063cae543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae53c expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907083.552664:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa511995200/0x72bb6cf063cae543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae53c expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907083.552677:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa511995200/0x72bb6cf063cae543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae53c expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907083.552692:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511995200, rc 0) 00000100:00100000:3.0:1787907083.552753:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+19:14374:x1874756000391168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907083.552762:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787907083.553329:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000391168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787907083.553350:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0600/0x72bb6cf063cae53c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae543 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907083.553361:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0600/0x72bb6cf063cae53c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae543 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907083.553456:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000391296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787907083.553507:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907083.553546:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5083b2300 going to sleep for 11 seconds 00000100:00100000:3.0:1787907083.557689:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000391296 00000100:00100000:3.0:1787907083.557720:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000391296 00000100:00100000:3.0:1787907083.558053:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787907083.558069:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+19:14374:x1874756000391296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787907083.558120:0:14372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787907083.558155:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787907083.558159:0:14372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787907083.558378:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+19:14374:x1874756000391296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 312us (4869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907083.558387:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787907083.559282:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000391296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787907083.559381:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787907083.559406:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0600/0x72bb6cf063cae53c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae543 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907083.559419:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0600/0x72bb6cf063cae53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae543 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907083.685046:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907084.705412:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907085.732030:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907086.752796:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787907087.009880:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000391424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787907087.009967:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907087.010066:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000391424 00000100:00100000:0.0:1787907087.010074:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000391424 00000100:00100000:0.0:1787907087.010130:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787907087.010140:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000391424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787907087.010178:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787907087.010224:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000391424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907087.010231:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787907087.010254:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787907087.010790:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000391424:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787907087.525529:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787907087.525536:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787907087.525540:0:37:0:(import.c:65:import_set_state_nolock()) ffff8aa541c77000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787907087.525548:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1787907087.525553:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787907087.525560:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8aa541c77000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1787907087.525583:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa535e8b800 x1874756000391680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787907087.525673:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ebba1202-2d0e-4d1e-8963-43f853425a20:3302:1874756000391552:0@lo:400:kworker.0 00000100:00100000:0.0:1787907087.525751:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907087.525803:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787907087.525809:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874756000392064:0@lo:400:kworker.0 00000100:00100000:0.0:1787907087.525863:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907087.525895:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000391680:0@lo:8:kworker.0 00000100:00100000:0.0:1787907087.525921:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907087.525948:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000391808:0@lo:400:kworker.0 00000100:00100000:0.0:1787907087.525972:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907087.525993:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787907087.525999:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000391936:0@lo:400:kworker.0 00000100:00100000:0.0:1787907087.526021:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907087.526053:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000391552 00000100:00100000:0.0:1787907087.526060:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000391552 00000100:00100000:0.0:1787907087.526105:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787907087.526115:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3302:x1874756000391552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907087.526164:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3302:x1874756000391552:12345-0@lo:400:kworker.0 Request processed in 50us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907087.526172:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787907087.526203:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000392064 00000100:00100000:0.0:1787907087.526207:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000392064 00000100:00100000:0.0:1787907087.526238:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000391808 00000100:00100000:0.0:1787907087.526241:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000391808 00000100:00100000:0.0:1787907087.526252:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000391936 00000100:00100000:0.0:1787907087.526254:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000391936 00000100:00100000:2.0:1787907087.526538:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000391680 00000100:00100000:2.0:1787907087.526544:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000391680 00000100:00100000:2.0:1787907087.526569:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787907087.526575:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3300:x1874756000391680:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787907087.526599:0:15061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:2.0:1787907087.526627:0:15061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bb6cf063cae54a 00002000:00100000:2.0:1787907087.526642:0:15061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8aa402ce6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113955 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787907087.526647:0:15061:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787907087.526649:0:15061:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787907087.527006:0:15061:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787907087.527030:0:15061:0:(import.c:65:import_set_state_nolock()) ffff8aa402ce1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787907087.527086:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1874756000391680:12345-0@lo:8:kworker.0 Request processed in 509us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907087.527093:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787907087.528453:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787907087.528473:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874756000392064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907087.528540:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874756000392064:12345-0@lo:400:kworker.0 Request processed in 71us (2677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907087.528546:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787907087.528562:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787907087.528568:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000391808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907087.528610:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874756000391808:12345-0@lo:400:kworker.0 Request processed in 42us (2636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907087.528616:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787907087.528629:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787907087.528635:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000391936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907087.528661:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000391936:12345-0@lo:400:kworker.0 Request processed in 27us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907087.528667:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787907087.528737:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa535e88a80 x1874756000392064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907087.528753:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874756000392064:0@lo:400:kworker.0 00000100:00100000:0.0:1787907087.528765:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ebba1202-2d0e-4d1e-8963-43f853425a20:3302:1874756000391552:0@lo:400:kworker.0 00000100:00080000:0.0:1787907087.528794:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787907087.528863:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa535e8b800 x1874756000391680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787907112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907087.528872:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787907087.528880:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787907087.528889:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787907087.528900:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787907087.528904:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8aa541c77000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787907087.528917:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787907087.528922:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874756000391680:0@lo:8:kworker.0 00000004:00080000:0.0:1787907087.528943:0:14401:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787907087.529486:0:14402:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1787907087.529507:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1874756000392320:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787907087.529555:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907087.529577:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5082553c0 going to sleep for 11 seconds 00010000:00080000:1.0:1787907087.529744:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa535e89c00 x1874756000391936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787907087.529755:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000391936:0@lo:400:kworker.0 00010000:00080000:1.0:1787907087.529776:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa535e8aa00 x1874756000391808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787907087.529785:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874756000391808:0@lo:400:kworker.0 00000100:00100000:1.0:1787907087.529853:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000392192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787907087.529885:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787907087.532671:0:14401:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 525804856020ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787907087.536668:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000392320 00000100:00100000:0.0:1787907087.536687:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000392320 00000100:00100000:0.0:1787907087.536779:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787907087.536791:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14402:x1874756000392320:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787907087.541955:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000392192 00000100:00100000:2.0:1787907087.541971:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000392192 00000100:00100000:2.0:1787907087.542042:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787907087.542053:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874756000392192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787907087.542092:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787907087.542184:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874756000392192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (12296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907087.542191:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787907087.542237:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa53495f800 x1874756000392192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787907103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787907087.543764:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000392192:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787907087.549857:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1787907087.557551:0:15060:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787907087.557568:0:15060:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787907087.557577:0:15060:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1787907087.584204:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787907087.584217:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae551 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.584249:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1787907087.584254:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787907087.586133:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.586165:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.586177:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.586192:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.586211:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787907087.586879:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787907087.586886:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae558 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.586898:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1787907087.586902:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787907087.586905:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.586914:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.586920:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.586926:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.586944:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787907087.586954:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787907087.586960:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.586976:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907087.586982:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.586990:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.587007:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae551 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.587014:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae551 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.587033:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787907087.587036:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.587041:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f400 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907087.587044:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.587052:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae558 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.587060:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae558 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.587072:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae558 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.587083:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.587085:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.587086:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.587312:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787907087.587788:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787907087.587795:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae55f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.587806:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1787907087.587866:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787907087.587872:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae55f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.587883:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae55f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.589804:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae55f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.593043:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae55f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.593085:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787907087.594583:0:15545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907087.594600:0:15545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae55f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.594613:0:15545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f800 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.594619:0:15545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae55f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.594631:0:15545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae55f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.594670:0:15545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae55f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.594678:0:15545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f52553c/0x72bb6cf063cae55f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.594707:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.594709:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.594711:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787907087.595179:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787907087.595189:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063e64b07/0x72bb6cf063cae566 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.595202:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1787907087.595207:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787907087.595215:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063e64b07/0x72bb6cf063cae566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.595228:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063e64b07/0x72bb6cf063cae566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.595236:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063e64b07/0x72bb6cf063cae566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.595243:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063e64b07/0x72bb6cf063cae566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.595769:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787907087.596324:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787907087.596332:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029fa583/0x72bb6cf063cae56d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.596344:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1787907087.596347:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787907087.596364:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000029fa583/0x72bb6cf063cae56d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.597152:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907087.597163:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063e64b07/0x72bb6cf063cae566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.597175:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8e000 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.597180:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063e64b07/0x72bb6cf063cae566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.597192:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063e64b07/0x72bb6cf063cae566 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.597213:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063e64b07/0x72bb6cf063cae566 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.597221:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063e64b07/0x72bb6cf063cae566 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.597258:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.597270:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.597273:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787907087.597897:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787907087.599013:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000029fa583/0x72bb6cf063cae56d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.599026:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029fa583/0x72bb6cf063cae56d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.599034:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000029fa583/0x72bb6cf063cae56d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.599069:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787907087.599481:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907087.599490:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000029fa583/0x72bb6cf063cae56d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.599499:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8fc00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.599505:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000029fa583/0x72bb6cf063cae56d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.599515:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000029fa583/0x72bb6cf063cae56d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.599533:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000029fa583/0x72bb6cf063cae56d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.599541:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000029fa583/0x72bb6cf063cae56d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.599568:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.599571:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.599572:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787907087.601845:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787907087.601858:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae574 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.601874:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1787907087.601880:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787907087.601886:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.601900:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.601912:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.601932:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.601955:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787907087.602526:0:15545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907087.602535:0:15545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.602558:0:15545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8ec00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.602563:0:15545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.602572:0:15545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae574 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.602590:0:15545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae574 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.602596:0:15545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad825915/0x72bb6cf063cae574 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.602616:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.602618:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.602620:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787907087.603030:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787907087.603039:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a96e189/0x72bb6cf063cae57b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.603051:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1787907087.603054:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787907087.603060:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a96e189/0x72bb6cf063cae57b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.603069:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a96e189/0x72bb6cf063cae57b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.603077:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a96e189/0x72bb6cf063cae57b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.603084:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a96e189/0x72bb6cf063cae57b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.603104:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787907087.603573:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907087.603581:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a96e189/0x72bb6cf063cae57b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.603590:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f200 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.603595:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a96e189/0x72bb6cf063cae57b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.603603:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a96e189/0x72bb6cf063cae57b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.603624:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a96e189/0x72bb6cf063cae57b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.603631:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a96e189/0x72bb6cf063cae57b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.603650:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.603652:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.603654:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787907087.604801:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787907087.604960:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b508da7/0x72bb6cf063cae582 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.604982:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1787907087.604986:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787907087.604992:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b508da7/0x72bb6cf063cae582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.605004:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b508da7/0x72bb6cf063cae582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.605012:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b508da7/0x72bb6cf063cae582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.605019:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b508da7/0x72bb6cf063cae582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.605085:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787907087.605589:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787907087.605596:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae589 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.605605:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1787907087.605608:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787907087.605613:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.605621:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.605639:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.605646:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.606069:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787907087.606077:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b508da7/0x72bb6cf063cae582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.606086:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8ee00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.606091:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b508da7/0x72bb6cf063cae582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.606101:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b508da7/0x72bb6cf063cae582 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.606117:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b508da7/0x72bb6cf063cae582 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.606125:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b508da7/0x72bb6cf063cae582 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.606160:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907087.606163:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae589 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.606169:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f400 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.606172:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae589 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.606179:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae589 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.606190:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae589 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.606197:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.606198:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.606200:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.606670:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787907087.606678:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a41f9a4/0x72bb6cf063cae589 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787907087.607994:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787907087.608006:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae590 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.608021:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1787907087.608026:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787907087.608033:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.608045:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.608056:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.608074:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.608141:0:15545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907087.608149:0:15545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae590 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.608157:0:15545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa53ac8f600 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.608162:0:15545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae590 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.608182:0:15545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae590 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.608197:0:15545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae590 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.608205:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.608207:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.608208:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.608986:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787907087.608996:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000766d82a6/0x72bb6cf063cae590 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787907087.609682:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787907087.609691:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000216c2615/0x72bb6cf063cae597 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.609704:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1787907087.609708:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787907087.609713:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000216c2615/0x72bb6cf063cae597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.609736:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000216c2615/0x72bb6cf063cae597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.609745:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000216c2615/0x72bb6cf063cae597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.609753:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000216c2615/0x72bb6cf063cae597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.611201:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907087.611213:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000216c2615/0x72bb6cf063cae597 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.611494:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403747e00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.611501:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000216c2615/0x72bb6cf063cae597 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.611513:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000216c2615/0x72bb6cf063cae597 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.611536:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000216c2615/0x72bb6cf063cae597 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.611549:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.611551:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.611553:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.611676:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787907087.611686:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000216c2615/0x72bb6cf063cae597 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787907087.612522:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787907087.612531:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000436476c3/0x72bb6cf063cae59e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.612544:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1787907087.612548:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787907087.612555:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000436476c3/0x72bb6cf063cae59e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.612567:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000436476c3/0x72bb6cf063cae59e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.612576:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000436476c3/0x72bb6cf063cae59e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.612583:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000436476c3/0x72bb6cf063cae59e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.614696:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907087.614727:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000436476c3/0x72bb6cf063cae59e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.614744:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403746000 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.614750:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000436476c3/0x72bb6cf063cae59e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.614764:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000436476c3/0x72bb6cf063cae59e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.614789:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000436476c3/0x72bb6cf063cae59e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.614802:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.614804:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.614806:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.614963:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787907087.614972:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000436476c3/0x72bb6cf063cae59e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.615919:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787907087.616924:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787907087.616936:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042fbc261/0x72bb6cf063cae5a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.616951:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1787907087.616956:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787907087.616961:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042fbc261/0x72bb6cf063cae5a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.616974:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042fbc261/0x72bb6cf063cae5a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.616983:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042fbc261/0x72bb6cf063cae5a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.616990:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042fbc261/0x72bb6cf063cae5a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.617039:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787907087.617506:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787907087.617513:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ff67cbc/0x72bb6cf063cae5ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.617523:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1787907087.617526:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787907087.617536:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ff67cbc/0x72bb6cf063cae5ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.617546:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ff67cbc/0x72bb6cf063cae5ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.617554:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ff67cbc/0x72bb6cf063cae5ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.617561:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ff67cbc/0x72bb6cf063cae5ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.617926:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787907087.617934:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042fbc261/0x72bb6cf063cae5a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.617944:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403746200 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.617949:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042fbc261/0x72bb6cf063cae5a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.617960:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042fbc261/0x72bb6cf063cae5a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.617991:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042fbc261/0x72bb6cf063cae5a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.617999:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042fbc261/0x72bb6cf063cae5a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.618030:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907087.618034:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ff67cbc/0x72bb6cf063cae5ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.618042:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403746800 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.618046:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ff67cbc/0x72bb6cf063cae5ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.618055:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ff67cbc/0x72bb6cf063cae5ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.618066:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ff67cbc/0x72bb6cf063cae5ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.618074:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.618076:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.618079:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.618179:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787907087.618185:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ff67cbc/0x72bb6cf063cae5ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.618923:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787907087.619804:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787907087.619837:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a021179f/0x72bb6cf063cae5b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.619852:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787907087.619857:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907087.619864:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a021179f/0x72bb6cf063cae5b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.619880:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a021179f/0x72bb6cf063cae5b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.619891:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a021179f/0x72bb6cf063cae5b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.619899:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a021179f/0x72bb6cf063cae5b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.619925:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787907087.620617:0:15545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907087.620625:0:15545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a021179f/0x72bb6cf063cae5b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.620641:0:15545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210c00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.620646:0:15545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a021179f/0x72bb6cf063cae5b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.620655:0:15545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a021179f/0x72bb6cf063cae5b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.620672:0:15545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a021179f/0x72bb6cf063cae5b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.620679:0:15545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a021179f/0x72bb6cf063cae5b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.620696:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.620698:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.620699:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787907087.621143:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787907087.621157:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc2db196/0x72bb6cf063cae5ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.621169:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787907087.621173:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907087.621179:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc2db196/0x72bb6cf063cae5ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.621192:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc2db196/0x72bb6cf063cae5ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.621202:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc2db196/0x72bb6cf063cae5ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.621210:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc2db196/0x72bb6cf063cae5ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.621230:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787907087.622565:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787907087.622579:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc2db196/0x72bb6cf063cae5ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.622592:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211600 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907087.622598:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc2db196/0x72bb6cf063cae5ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.622610:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc2db196/0x72bb6cf063cae5ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.622649:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc2db196/0x72bb6cf063cae5ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.622656:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc2db196/0x72bb6cf063cae5ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.622679:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.622681:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.622683:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787907087.622939:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787907087.622946:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2a693a/0x72bb6cf063cae5c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.622956:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787907087.622960:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907087.622965:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2a693a/0x72bb6cf063cae5c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.622975:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f2a693a/0x72bb6cf063cae5c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.622988:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2a693a/0x72bb6cf063cae5c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.622995:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f2a693a/0x72bb6cf063cae5c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.623021:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787907087.623092:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787907087.623099:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f2a693a/0x72bb6cf063cae5c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.623108:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211200 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907087.623111:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f2a693a/0x72bb6cf063cae5c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.623119:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f2a693a/0x72bb6cf063cae5c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.623134:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f2a693a/0x72bb6cf063cae5c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.623142:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f2a693a/0x72bb6cf063cae5c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.623173:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.623176:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.623179:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787907087.623401:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787907087.623407:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a42827c3/0x72bb6cf063cae5c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.623415:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787907087.623418:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907087.623421:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a42827c3/0x72bb6cf063cae5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.623430:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a42827c3/0x72bb6cf063cae5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.623438:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a42827c3/0x72bb6cf063cae5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.623444:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a42827c3/0x72bb6cf063cae5c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.623478:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787907087.623516:0:15545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907087.623525:0:15545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a42827c3/0x72bb6cf063cae5c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.623534:0:15545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211800 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907087.623539:0:15545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a42827c3/0x72bb6cf063cae5c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.623556:0:15545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a42827c3/0x72bb6cf063cae5c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.623572:0:15545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a42827c3/0x72bb6cf063cae5c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.623581:0:15545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a42827c3/0x72bb6cf063cae5c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.623613:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907087.623616:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907087.623619:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787907087.623947:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787907087.623954:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061da8e92/0x72bb6cf063cae5cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.623962:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787907087.623966:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907087.623970:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061da8e92/0x72bb6cf063cae5cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.623980:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061da8e92/0x72bb6cf063cae5cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.623989:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061da8e92/0x72bb6cf063cae5cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.623996:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061da8e92/0x72bb6cf063cae5cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.624025:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787907087.624064:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907087.624071:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061da8e92/0x72bb6cf063cae5cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.624080:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907087.624085:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061da8e92/0x72bb6cf063cae5cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.624093:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061da8e92/0x72bb6cf063cae5cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.624108:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061da8e92/0x72bb6cf063cae5cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.624130:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061da8e92/0x72bb6cf063cae5cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.624155:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907087.624158:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907087.624163:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787907087.624490:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787907087.624496:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5192389/0x72bb6cf063cae5d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.624505:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787907087.624515:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907087.624520:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5192389/0x72bb6cf063cae5d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.624530:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5192389/0x72bb6cf063cae5d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.624539:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5192389/0x72bb6cf063cae5d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.624546:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5192389/0x72bb6cf063cae5d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.624570:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787907087.624809:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907087.624835:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5192389/0x72bb6cf063cae5d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.624842:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210200 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907087.624846:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5192389/0x72bb6cf063cae5d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.624853:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5192389/0x72bb6cf063cae5d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.624865:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5192389/0x72bb6cf063cae5d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.624872:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5192389/0x72bb6cf063cae5d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.624887:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907087.624888:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907087.624890:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787907087.627478:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787907087.627490:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4311d87/0x72bb6cf063cae5dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.627507:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787907087.627511:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907087.627517:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4311d87/0x72bb6cf063cae5dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.627530:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4311d87/0x72bb6cf063cae5dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.627539:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4311d87/0x72bb6cf063cae5dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.627553:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4311d87/0x72bb6cf063cae5dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.627579:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787907087.627609:0:15545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907087.627618:0:15545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4311d87/0x72bb6cf063cae5dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.627628:0:15545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508211e00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907087.627633:0:15545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4311d87/0x72bb6cf063cae5dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.627644:0:15545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4311d87/0x72bb6cf063cae5dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.627661:0:15545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4311d87/0x72bb6cf063cae5dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.627669:0:15545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4311d87/0x72bb6cf063cae5dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907087.627779:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907087.627782:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907087.627783:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787907087.628210:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787907087.628216:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cae5e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.628225:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787907087.628229:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907087.628233:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cae5e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.628241:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cae5e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.628249:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cae5e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.628256:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cae5e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.628279:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787907087.629494:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787907087.629508:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003770c198/0x72bb6cf063cae5eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.629527:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787907087.629531:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907087.629536:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003770c198/0x72bb6cf063cae5eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.629548:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003770c198/0x72bb6cf063cae5eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.629557:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003770c198/0x72bb6cf063cae5eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.629564:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003770c198/0x72bb6cf063cae5eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.629602:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787907087.629807:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787907087.629894:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cae5e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.629905:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210a00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907087.629910:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cae5e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.629920:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cae5e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.629937:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cae5e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.629945:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064de3e00/0x72bb6cf063cae5e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.629970:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787907087.629974:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003770c198/0x72bb6cf063cae5eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.629981:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210400 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907087.629992:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003770c198/0x72bb6cf063cae5eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.630000:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003770c198/0x72bb6cf063cae5eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.630010:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003770c198/0x72bb6cf063cae5eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.630018:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003770c198/0x72bb6cf063cae5eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.630033:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.630035:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.630036:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787907087.630271:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787907087.630277:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d277f2a/0x72bb6cf063cae5f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.630287:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787907087.630290:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907087.630295:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d277f2a/0x72bb6cf063cae5f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.630305:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d277f2a/0x72bb6cf063cae5f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.630347:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d277f2a/0x72bb6cf063cae5f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.630355:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d277f2a/0x72bb6cf063cae5f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.630371:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787907087.630380:0:15545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787907087.630384:0:15545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d277f2a/0x72bb6cf063cae5f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.630391:0:15545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210e00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:1.0:1787907087.630395:0:15545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d277f2a/0x72bb6cf063cae5f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.630404:0:15545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d277f2a/0x72bb6cf063cae5f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.630414:0:15545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d277f2a/0x72bb6cf063cae5f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.630422:0:15545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d277f2a/0x72bb6cf063cae5f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.630435:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907087.630441:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907087.630443:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907087.632041:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787907087.633170:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787907087.633184:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000972b1dfc/0x72bb6cf063cae5f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.633200:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787907087.633204:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907087.633210:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000972b1dfc/0x72bb6cf063cae5f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.633224:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000972b1dfc/0x72bb6cf063cae5f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.633235:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000972b1dfc/0x72bb6cf063cae5f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.633243:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000972b1dfc/0x72bb6cf063cae5f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.633261:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787907087.634158:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787907087.634169:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000972b1dfc/0x72bb6cf063cae5f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.634181:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa508210800 already unused, calling callback (ffffffffc1439230) 00010000:00010000:0.0:1787907087.634185:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000972b1dfc/0x72bb6cf063cae5f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.634196:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000972b1dfc/0x72bb6cf063cae5f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.634215:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000972b1dfc/0x72bb6cf063cae5f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.634230:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000972b1dfc/0x72bb6cf063cae5f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907087.634255:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.634257:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787907087.634259:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787907087.635478:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787907087.635490:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd776e1/0x72bb6cf063cae600 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.635504:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787907087.635508:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907087.635514:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bd776e1/0x72bb6cf063cae600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.635533:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bd776e1/0x72bb6cf063cae600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.635544:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd776e1/0x72bb6cf063cae600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.635552:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bd776e1/0x72bb6cf063cae600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.635581:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787907087.638169:0:15545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907087.638182:0:15545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bd776e1/0x72bb6cf063cae600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.638194:0:15545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fba00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.638200:0:15545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd776e1/0x72bb6cf063cae600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.638211:0:15545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd776e1/0x72bb6cf063cae600 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.638251:0:15545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bd776e1/0x72bb6cf063cae600 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.638270:0:15545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bd776e1/0x72bb6cf063cae600 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.638294:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.638296:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.638298:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787907087.638556:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787907087.638565:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fa7bb06/0x72bb6cf063cae607 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.638577:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787907087.638581:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907087.638588:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fa7bb06/0x72bb6cf063cae607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.638600:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fa7bb06/0x72bb6cf063cae607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.638610:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fa7bb06/0x72bb6cf063cae607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.638777:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fa7bb06/0x72bb6cf063cae607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907087.638877:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787907087.639210:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787907087.639227:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fa7bb06/0x72bb6cf063cae607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.639237:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fac00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:2.0:1787907087.639242:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fa7bb06/0x72bb6cf063cae607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.639252:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fa7bb06/0x72bb6cf063cae607 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787907087.639323:0:15060:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1787907087.639426:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14402:x1874756000392320:12345-0@lo:5:osp-pre-1-0.0 Request processed in 102632us (109866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907087.639451:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787907087.639538:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fa7bb06/0x72bb6cf063cae607 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.639545:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fa7bb06/0x72bb6cf063cae607 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907087.639575:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.639577:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907087.639578:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787907087.639625:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1874756000392320:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787907087.639641:0:14402:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1787907087.639691:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1874756000392448:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787907087.639747:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907087.639800:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5082553c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787907087.640216:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000392448 00000100:00100000:1.0:1787907087.640223:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000392448 00000100:00100000:1.0:1787907087.640276:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787907087.640285:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14402:x1874756000392448:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787907087.640334:0:15062:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1787907087.648107:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14402:x1874756000392448:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7814us (8351us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787907087.648121:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787907087.648133:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1874756000392448:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787907087.648152:0:14402:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1787907087.779976:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907088.800018:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787907089.566380:0:16133:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787907089.831451:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907090.849903:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907091.881619:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787907092.130706:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787907092.130729:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000392576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787907092.130803:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907092.131311:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000392576 00000100:00100000:2.0:1787907092.131321:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000392576 00000100:00100000:2.0:1787907092.131380:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787907092.131390:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000392576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787907092.131425:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787907092.131480:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000392576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907092.131487:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787907092.131507:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787907092.131548:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000392576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787907092.228752:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907092.228860:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972081408 00000100:00100000:2.0:1787907092.228871:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972081408 00000100:00100000:2.0:1787907092.228926:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:2.0:1787907092.228934:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2342:x1874755972081408:12345-192.168.204.20@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787907092.228962:0:14369:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0cf71194-8f86-474c-b7fd-37f1c612ad57@192.168.204.20@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:2.0:1787907092.228993:0:14369:0:(genops.c:1385:class_connect()) connect: client 0cf71194-8f86-474c-b7fd-37f1c612ad57, cookie 0x72bb6cf063cae60e 00000100:00080000:2.0:1787907092.229121:0:14369:0:(import.c:65:import_set_state_nolock()) ffff8aa402ce2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787907092.229206:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+5:2342:x1874755972081408:12345-192.168.204.20@tcp:250:mount.lustre.0 Request processed in 270us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907092.229214:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:2.0:1787907092.246455:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907092.246603:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972081536 00000100:00100000:0.0:1787907092.246617:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972081536 00000100:00100000:0.0:1787907092.246688:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:0.0:1787907092.246699:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+5:13763:x1874755972081536:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787907092.246715:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907092.246733:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa403747200/0x72bb6cf063cae615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef9e4 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907092.246764:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa403747200/0x72bb6cf063cae615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9e4 expref: 6 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907092.246777:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa403747200/0x72bb6cf063cae615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9e4 expref: 6 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907092.246788:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa403747200, rc 0) 00000100:00100000:0.0:1787907092.246899:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+6:13763:x1874755972081536:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 201us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907092.246924:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:3.0:1787907092.260996:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907092.261183:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972081664 00000100:00100000:0.0:1787907092.261199:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972081664 00000100:00100000:0.0:1787907092.261293:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:0.0:1787907092.261308:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+6:13763:x1874755972081664:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787907092.263348:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+6:13763:x1874755972081664:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 838us (3328us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787907092.263371:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:3.0:1787907092.269853:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907092.270521:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972081792 00000100:00100000:2.0:1787907092.270538:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972081792 00000100:00100000:2.0:1787907092.270701:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:2.0:1787907092.270716:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+6:13763:x1874755972081792:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787907092.270741:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907092.270772:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa50efd0800/0x72bb6cf063cae61c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155ef9eb expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907092.270855:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa50efd0800/0x72bb6cf063cae61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9eb expref: 7 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907092.270869:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa50efd0800/0x72bb6cf063cae61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155ef9eb expref: 7 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907092.270881:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd0800, rc 0) 00000100:00100000:2.0:1787907092.270968:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+7:13763:x1874755972081792:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 256us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907092.270996:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:2.0:1787907092.276688:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907092.276851:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972081920 00000100:00100000:0.0:1787907092.276865:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972081920 00000100:00100000:0.0:1787907092.276935:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:0.0:1787907092.276949:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+7:13763:x1874755972081920:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787907092.277461:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+8:13763:x1874755972081920:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 510us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907092.277471:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:0.0:1787907092.283996:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907092.284126:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972082048 00000100:00100000:3.0:1787907092.284140:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972082048 00000100:00100000:3.0:1787907092.284224:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:3.0:1787907092.284237:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+8:13763:x1874755972082048:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787907092.290852:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+8:13763:x1874755972082048:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 6579us (6834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907092.290880:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:3.0:1787907092.305521:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907092.306249:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972082176 00000100:00100000:2.0:1787907092.306280:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972082176 00000100:00100000:2.0:1787907092.306414:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:2.0:1787907092.306430:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+8:13782:x1874755972082176:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787907092.306893:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+8:13782:x1874755972082176:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 467us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907092.306904:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:0.0:1787907092.321676:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907092.322240:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972082304 00000100:00100000:2.0:1787907092.322256:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972082304 00000100:00100000:2.0:1787907092.322715:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:2.0:1787907092.322729:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+8:13782:x1874755972082304:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787907092.325153:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+8:13782:x1874755972082304:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 2401us (3466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907092.325175:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:3.0:1787907092.351501:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907092.351871:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972082432 00000100:00100000:2.0:1787907092.351887:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972082432 00000100:00100000:2.0:1787907092.351979:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:2.0:1787907092.351992:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+8:13763:x1874755972082432:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787907092.352018:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907092.352060:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa50efd0200/0x72bb6cf063cae623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efa15 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907092.352098:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa50efd0200/0x72bb6cf063cae623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa15 expref: 9 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907092.352112:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa50efd0200/0x72bb6cf063cae623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa15 expref: 9 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907092.352122:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd0200, rc 0) 00000100:00100000:2.0:1787907092.352210:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+9:13763:x1874755972082432:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 220us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907092.352218:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:3.0:1787907092.356748:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907092.357248:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972082560 00000100:00100000:2.0:1787907092.357262:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972082560 00000100:00100000:2.0:1787907092.357343:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:2.0:1787907092.357357:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+9:13763:x1874755972082560:12345-192.168.204.20@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787907092.357404:0:14372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787907092.357440:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787907092.357444:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787907092.357448:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787907092.357451:0:14372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787907092.369269:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+9:13763:x1874755972082560:12345-192.168.204.20@tcp:256:mount.lustre.0 Request processed in 11897us (12518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907092.369289:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:1.0:1787907092.379557:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907092.379757:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972082688 00000100:00100000:0.0:1787907092.379771:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972082688 00000100:00100000:0.0:1787907092.379884:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:0.0:1787907092.379897:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+9:13763:x1874755972082688:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787907092.379920:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907092.379945:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa403746a00/0x72bb6cf063cae62a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efa1c expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907092.380006:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa403746a00/0x72bb6cf063cae62a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa1c expref: 10 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907092.380019:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa403746a00/0x72bb6cf063cae62a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa1c expref: 10 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907092.380029:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa403746a00, rc 0) 00000100:00100000:0.0:1787907092.380100:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+10:13763:x1874755972082688:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 206us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907092.380108:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:3.0:1787907092.392023:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907092.392417:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972082816 00000100:00100000:2.0:1787907092.392437:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972082816 00000100:00100000:2.0:1787907092.392553:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:2.0:1787907092.392567:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+10:13763:x1874755972082816:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787907092.393437:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+10:13763:x1874755972082816:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 865us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907092.393449:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:1.0:1787907092.401648:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907092.401760:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972082944 00000100:00100000:3.0:1787907092.401776:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972082944 00000100:00100000:2.0:1787907092.403427:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:2.0:1787907092.403453:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+10:13763:x1874755972082944:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787907092.403974:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+10:13763:x1874755972082944:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 532us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907092.403985:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:1.0:1787907092.410550:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907092.410909:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972083072 00000100:00100000:2.0:1787907092.410925:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972083072 00000100:00100000:2.0:1787907092.411012:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 87 00000100:00100000:2.0:1787907092.411026:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+10:13786:x1874755972083072:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787907092.411616:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+10:13786:x1874755972083072:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 589us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907092.411637:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 87 00000100:00100000:3.0:1787907092.418616:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907092.418951:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972083200 00000100:00100000:2.0:1787907092.418977:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972083200 00000100:00100000:2.0:1787907092.419055:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 88 00000100:00100000:2.0:1787907092.419067:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+10:13786:x1874755972083200:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787907092.419712:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+10:13786:x1874755972083200:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 644us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907092.419723:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 88 00000100:00100000:1.0:1787907092.436465:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907092.436852:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972083328 00000100:00100000:0.0:1787907092.436868:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972083328 00000100:00100000:0.0:1787907092.436942:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:0.0:1787907092.436954:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2342:x1874755972083328:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787907092.437015:0:14379:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b3584eb2-bb70-4147-abd7-b7e752b5bc9e@192.168.204.20@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:0.0:1787907092.437094:0:14379:0:(genops.c:1385:class_connect()) connect: client b3584eb2-bb70-4147-abd7-b7e752b5bc9e, cookie 0x72bb6cf063cae631 00000004:00100000:0.0:1787907092.437136:0:14379:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787907092.437152:0:14379:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787907092.489332:0:14379:0:(import.c:65:import_set_state_nolock()) ffff8aa534499800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787907092.489446:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:2342:x1874755972083328:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 52490us (52994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907092.489460:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:1.0:1787907092.493317:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907092.493370:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907092.493470:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972083456 00000100:00100000:0.0:1787907092.493485:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972083456 00000100:00100000:0.0:1787907092.493637:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972083584 00000100:00100000:0.0:1787907092.493642:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972083584 00000100:00100000:0.0:1787907092.493685:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:0.0:1787907092.493697:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:0:x1874755972083456:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787907092.493767:0:14377:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787907092.493912:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:0:x1874755972083456:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 216us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907092.493921:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:0.0:1787907092.493939:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:0.0:1787907092.493946:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:13763:x1874755972083584:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787907092.493957:0:14377:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787907092.493978:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:13763:x1874755972083584:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 33us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907092.493985:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00080000:1.0:1787907092.495521:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787907092.496536:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907092.496649:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972083712 00000100:00100000:0.0:1787907092.496660:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972083712 00000100:00100000:0.0:1787907092.496730:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:0.0:1787907092.496741:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:13763:x1874755972083712:12345-192.168.204.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787907092.496868:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:13763:x1874755972083712:12345-192.168.204.20@tcp:40:mount.lustre.0 Request processed in 129us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907092.496875:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:0.0:1787907092.506601:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907092.506665:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907092.506703:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907092.506796:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972083840 00000100:00100000:1.0:1787907092.506866:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972083840 00000100:00100000:1.0:1787907092.506916:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972083968 00000100:00100000:1.0:1787907092.506919:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972083968 00000100:00100000:1.0:1787907092.506935:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1787907092.506947:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2342:x1874755972083840:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787907092.506992:0:15060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b3584eb2-bb70-4147-abd7-b7e752b5bc9e@192.168.204.20@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:1.0:1787907092.507038:0:15060:0:(genops.c:1385:class_connect()) connect: client b3584eb2-bb70-4147-abd7-b7e752b5bc9e, cookie 0x72bb6cf063cae638 00002000:00100000:1.0:1787907092.507056:0:15060:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b3584eb2-bb70-4147-abd7-b7e752b5bc9e/ffff8aa510323800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787907092.507070:0:15060:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787907092.507562:0:15060:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787907092.507605:0:15060:0:(import.c:65:import_set_state_nolock()) ffff8aa510327800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787907092.507705:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:2342:x1874755972083840:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 758us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907092.507714:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1787907092.507738:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1787907092.507743:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2342:x1874755972083968:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787907092.507761:0:15060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b3584eb2-bb70-4147-abd7-b7e752b5bc9e@192.168.204.20@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:1.0:1787907092.507782:0:15060:0:(genops.c:1385:class_connect()) connect: client b3584eb2-bb70-4147-abd7-b7e752b5bc9e, cookie 0x72bb6cf063cae63f 00002000:00100000:1.0:1787907092.507788:0:15060:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b3584eb2-bb70-4147-abd7-b7e752b5bc9e/ffff8aa510321000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787907092.507809:0:15060:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787907092.507995:0:15060:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787907092.508013:0:15060:0:(import.c:65:import_set_state_nolock()) ffff8aa510320000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787907092.508038:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:2342:x1874755972083968:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 294us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907092.508046:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:3.0:1787907092.508577:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972084096 00000100:00100000:3.0:1787907092.508586:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972084096 00000100:00100000:3.0:1787907092.508644:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1787907092.508653:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:13763:x1874755972084096:12345-192.168.204.20@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787907092.510506:0:14380:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1777us 00000004:00200000:2.0:1787907092.528552:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787907092.528795:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:13763:x1874755972084096:12345-192.168.204.20@tcp:33:mount.lustre.0 Request processed in 20135us (22199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907092.528855:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:0.0:1787907092.640256:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000392960:0@lo:400:kworker.0 00000100:00100000:2.0:1787907092.640310:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ebba1202-2d0e-4d1e-8963-43f853425a20:3304:1874756000392704:0@lo:400:kworker.0 00000100:00100000:0.0:1787907092.640348:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907092.640467:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000393088:0@lo:400:kworker.0 00000100:00100000:3.0:1787907092.640497:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000392832:0@lo:400:kworker.0 00000100:00100000:2.0:1787907092.643802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907092.643925:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000393216:0@lo:400:kworker.0 00000100:00100000:2.0:1787907092.643988:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907092.644147:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000392704 00000100:00100000:2.0:1787907092.644160:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000392704 00000100:00100000:2.0:1787907092.644228:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787907092.644240:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3304:x1874756000392704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907092.645023:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000392960 00000100:00100000:0.0:1787907092.645075:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000392960 00000100:00100000:0.0:1787907092.645144:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000393216 00000100:00100000:0.0:1787907092.645148:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000393216 00000100:00100000:0.0:1787907092.645186:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787907092.645197:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000392960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907092.645315:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000392960:12345-0@lo:400:kworker.0 Request processed in 118us (4968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907092.645322:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787907092.645339:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787907092.645345:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000393216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907092.645395:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874756000393216:12345-0@lo:400:kworker.0 Request processed in 50us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907092.645402:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787907092.645453:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa507ccaa00 x1874756000393216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907092.645469:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874756000393216:0@lo:400:kworker.0 00010000:00080000:0.0:1787907092.645509:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa507cc9500 x1874756000392960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787907092.645518:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000392960:0@lo:400:kworker.0 00000100:00100000:0.0:1787907092.645530:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787907092.645541:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000393344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787907092.645577:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787907092.645632:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787907092.645655:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000393344 00000100:00100000:0.0:1787907092.645659:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000393344 00000100:00100000:0.0:1787907092.645702:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787907092.645717:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874756000393344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787907092.645732:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787907092.645770:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874756000393344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907092.645776:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787907092.645796:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787907092.645844:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000393344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787907092.649215:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907092.649270:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907092.649327:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000393088 00000100:00100000:1.0:1787907092.649339:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000393088 00000100:00100000:1.0:1787907092.649425:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787907092.649442:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000393088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787907092.649592:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3304:x1874756000392704:12345-0@lo:400:kworker.0 Request processed in 5348us (5798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907092.649607:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787907092.650587:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000393088:12345-0@lo:400:kworker.0 Request processed in 1145us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907092.650600:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787907092.650647:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787907092.652613:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ebba1202-2d0e-4d1e-8963-43f853425a20:3304:1874756000392704:0@lo:400:kworker.0 00000100:00100000:0.0:1787907092.703963:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000392832 00000100:00100000:0.0:1787907092.703979:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000392832 00000100:00100000:0.0:1787907092.704058:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787907092.704068:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1874756000392832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907092.704173:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1874756000392832:12345-0@lo:400:kworker.0 Request processed in 106us (54910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907092.704181:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787907092.704320:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000392832:0@lo:400:kworker.0 00010000:00080000:2.0:1787907092.721938:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa507cca300 x1874756000393088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787907108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787907092.721966:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000393088:0@lo:400:kworker.0 00000100:00100000:1.0:1787907092.770455:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907092.788957:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972084224 00000100:00100000:2.0:1787907092.788979:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972084224 00000100:00100000:2.0:1787907092.789064:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:2.0:1787907092.789077:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:13807:x1874755972084224:12345-192.168.204.20@tcp:101:mkdir.0 00010000:00010000:2.0:1787907092.789101:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907092.789133:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1400/0x72bb6cf063cae646 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efa46 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907092.789208:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1800/0x72bb6cf063cae64d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907092.789242:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1800/0x72bb6cf063cae64d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907092.789258:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1800/0x72bb6cf063cae64d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787907092.789492:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787907092.789496:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787907092.789605:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1800/0x72bb6cf063cae64d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907092.789647:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1400/0x72bb6cf063cae646 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa46 expref: 8 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907092.789666:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1800/0x72bb6cf063cae64d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa46 expref: 7 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907092.789676:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:2.0:1787907092.789680:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787907092.789683:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd1800, rc 0) 00000100:00100000:2.0:1787907092.789757:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:13807:x1874755972084224:12345-192.168.204.20@tcp:101:mkdir.0 Request processed in 684us (19318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907092.789765:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000001:00100000:1.0:1787907092.832516:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b3584eb2-bb70-4147-abd7-b7e752b5bc9e 00000001:00080000:1.0:1787907092.832548:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1787907092.832579:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787907092.897504:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787907093.344556:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787907093.921010:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787907094.945553:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787907095.145329:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907095.145509:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972084352 00000100:00100000:1.0:1787907095.145522:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972084352 00000100:00100000:1.0:1787907095.145633:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1787907095.145649:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:13859:x1874755972084352:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:1.0:1787907095.145710:0:14379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787907095.145875:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:13859:x1874755972084352:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 231us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907095.145884:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00080000:0.0:1787907095.145967:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787907095.153992:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907095.154252:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972084480 00000100:00100000:0.0:1787907095.154266:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972084480 00000100:00100000:0.0:1787907095.154368:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:0.0:1787907095.154384:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:13859:x1874755972084480:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:0.0:1787907095.154443:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787907095.154557:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:13859:x1874755972084480:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 176us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907095.154565:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00080000:1.0:1787907095.154681:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787907095.161478:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907095.180209:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972084608 00000100:00100000:0.0:1787907095.180232:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972084608 00000100:00100000:0.0:1787907095.180375:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:0.0:1787907095.180388:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+5:13859:x1874755972084608:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:0.0:1787907095.180441:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787907095.180613:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+5:13859:x1874755972084608:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 226us (19150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907095.180622:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00080000:1.0:1787907095.181044:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787907095.316499:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907095.317171:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972084736 00000100:00100000:0.0:1787907095.317185:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972084736 00000100:00100000:0.0:1787907095.317277:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:0.0:1787907095.317290:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+10:13891:x1874755972084736:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787907095.317315:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907095.317340:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa403747400/0x72bb6cf063cae654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efa4d expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907095.317382:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa403747400/0x72bb6cf063cae654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa4d expref: 11 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907095.317394:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa403747400/0x72bb6cf063cae654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa4d expref: 11 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907095.317405:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa403747400, rc 0) 00000100:00100000:0.0:1787907095.317488:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+11:13891:x1874755972084736:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 200us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907095.317497:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:2.0:1787907095.323743:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907095.323993:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972084864 00000100:00100000:3.0:1787907095.324010:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972084864 00000100:00100000:3.0:1787907095.324098:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:3.0:1787907095.324113:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+11:13891:x1874755972084864:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787907095.324719:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+11:13891:x1874755972084864:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 598us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907095.324746:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:3.0:1787907095.331254:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907095.331776:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972084992 00000100:00100000:2.0:1787907095.331788:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972084992 00000100:00100000:2.0:1787907095.331903:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 92 00000100:00100000:2.0:1787907095.331914:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+11:13891:x1874755972084992:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787907095.332708:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+11:13891:x1874755972084992:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 791us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907095.332717:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 92 00000100:00100000:2.0:1787907095.338119:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907095.338408:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972085120 00000100:00100000:0.0:1787907095.338425:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972085120 00000100:00100000:0.0:1787907095.338510:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 93 00000100:00100000:0.0:1787907095.338523:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+11:13898:x1874755972085120:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787907095.338980:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+11:13898:x1874755972085120:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 457us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907095.338991:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 93 00000100:00100000:1.0:1787907095.353137:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907095.356632:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972085248 00000100:00100000:2.0:1787907095.356648:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972085248 00000100:00100000:2.0:1787907095.356720:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:2.0:1787907095.356731:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+11:13898:x1874755972085248:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787907095.359535:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+11:13898:x1874755972085248:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 2793us (6402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907095.359553:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:3.0:1787907095.365460:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907095.365728:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972085376 00000100:00100000:0.0:1787907095.365743:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972085376 00000100:00100000:0.0:1787907095.365957:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00100000:0.0:1787907095.365972:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+11:13891:x1874755972085376:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787907095.365995:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907095.366018:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa403747800/0x72bb6cf063cae65b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efa77 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907095.366057:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa403747800/0x72bb6cf063cae65b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa77 expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907095.366070:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa403747800/0x72bb6cf063cae65b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa77 expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907095.366081:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa403747800, rc 0) 00000100:00100000:0.0:1787907095.366165:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+12:13891:x1874755972085376:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 196us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907095.366173:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00100000:3.0:1787907095.373103:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907095.373272:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972085504 00000100:00100000:2.0:1787907095.373287:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972085504 00000100:00100000:2.0:1787907095.373360:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 96 00000100:00100000:2.0:1787907095.373373:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+12:13891:x1874755972085504:12345-192.168.204.20@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787907095.373409:0:14371:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787907095.373446:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787907095.373452:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787907095.373455:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787907095.373458:0:14371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787907095.376718:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+12:13891:x1874755972085504:12345-192.168.204.20@tcp:256:mount.lustre.0 Request processed in 3327us (3611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907095.376738:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 96 00000100:00100000:3.0:1787907095.386497:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907095.387384:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972085632 00000100:00100000:2.0:1787907095.387424:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972085632 00000100:00100000:2.0:1787907095.387509:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:2.0:1787907095.387523:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+12:13891:x1874755972085632:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787907095.387548:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907095.387585:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa50efd0000/0x72bb6cf063cae662 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efa7e expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907095.387623:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa50efd0000/0x72bb6cf063cae662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa7e expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907095.387637:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa50efd0000/0x72bb6cf063cae662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa7e expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907095.387651:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd0000, rc 0) 00000100:00100000:2.0:1787907095.390595:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:13891:x1874755972085632:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 3039us (4081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907095.390614:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:3.0:1787907095.402427:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907095.402862:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972085760 00000100:00100000:2.0:1787907095.402877:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972085760 00000100:00100000:2.0:1787907095.402956:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 98 00000100:00100000:2.0:1787907095.402970:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:13891:x1874755972085760:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787907095.403415:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:13891:x1874755972085760:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 445us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907095.403425:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 98 00000100:00100000:1.0:1787907095.414216:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907095.414583:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972085888 00000100:00100000:0.0:1787907095.414597:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972085888 00000100:00100000:0.0:1787907095.414666:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:0.0:1787907095.414679:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:13891:x1874755972085888:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787907095.415053:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:13891:x1874755972085888:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 374us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907095.415185:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:1.0:1787907095.422757:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907095.423101:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972086016 00000100:00100000:3.0:1787907095.423114:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972086016 00000100:00100000:3.0:1787907095.423189:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:3.0:1787907095.423212:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:13902:x1874755972086016:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787907095.423575:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:13902:x1874755972086016:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 362us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907095.423586:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:3.0:1787907095.432976:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907095.433109:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972086144 00000100:00100000:2.0:1787907095.433130:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972086144 00000100:00100000:2.0:1787907095.433203:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00100000:2.0:1787907095.433216:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:13902:x1874755972086144:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787907095.433577:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:13902:x1874755972086144:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 352us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907095.433588:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00100000:1.0:1787907095.461323:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907095.461903:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972086272 00000100:00100000:2.0:1787907095.461921:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972086272 00000100:00100000:2.0:1787907095.461992:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1787907095.462003:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2342:x1874755972086272:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787907095.462045:0:14378:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7105112f-1b7f-4c1e-bd83-6e301c02c68b@192.168.204.20@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:2.0:1787907095.462107:0:14378:0:(genops.c:1385:class_connect()) connect: client 7105112f-1b7f-4c1e-bd83-6e301c02c68b, cookie 0x72bb6cf063cae669 00000004:00100000:2.0:1787907095.462294:0:14378:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787907095.462472:0:14378:0:(import.c:65:import_set_state_nolock()) ffff8aa508a86000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787907095.462575:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:2342:x1874755972086272:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 561us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907095.462585:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:1.0:1787907095.489426:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907095.489543:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972086528 00000100:00100000:2.0:1787907095.489558:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972086528 00000100:00100000:2.0:1787907095.489912:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1787907095.489926:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:13891:x1874755972086528:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787907095.489974:0:14377:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787907095.490091:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:13891:x1874755972086528:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 159us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907095.490101:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:3.0:1787907095.491570:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907095.492003:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972086656 00000100:00100000:0.0:1787907095.492019:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972086656 00000100:00100000:0.0:1787907095.492110:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:0.0:1787907095.492130:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:13891:x1874755972086656:12345-192.168.204.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787907095.492245:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:13891:x1874755972086656:12345-192.168.204.20@tcp:40:mount.lustre.0 Request processed in 118us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907095.492254:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:3.0:1787907095.494642:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00080000:1.0:1787907095.494658:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787907095.494746:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972086784 00000100:00100000:0.0:1787907095.494762:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972086784 00000100:00100000:0.0:1787907095.495006:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1787907095.495019:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2342:x1874755972086784:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787907095.495068:0:15062:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7105112f-1b7f-4c1e-bd83-6e301c02c68b@192.168.204.20@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1787907095.495249:0:15062:0:(genops.c:1385:class_connect()) connect: client 7105112f-1b7f-4c1e-bd83-6e301c02c68b, cookie 0x72bb6cf063cae670 00002000:00100000:0.0:1787907095.495268:0:15062:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7105112f-1b7f-4c1e-bd83-6e301c02c68b/ffff8aa534499000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787907095.495284:0:15062:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787907095.495461:0:15062:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787907095.495505:0:15062:0:(import.c:65:import_set_state_nolock()) ffff8aa534498000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787907095.495691:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:2342:x1874755972086784:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 673us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907095.495702:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1787907095.513515:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907095.513595:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907095.513645:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907095.513842:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972086400 00000100:00100000:2.0:1787907095.513858:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972086400 00000100:00100000:2.0:1787907095.513941:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:2.0:1787907095.513962:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:0:x1874755972086400:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787907095.514007:0:14378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787907095.514341:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:0:x1874755972086400:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 381us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907095.514351:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1787907095.514888:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972087040 00000100:00100000:3.0:1787907095.514898:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972087040 00000100:00100000:3.0:1787907095.514945:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:3.0:1787907095.514955:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:13891:x1874755972087040:12345-192.168.204.20@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787907095.515471:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787907095.515763:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:13891:x1874755972087040:12345-192.168.204.20@tcp:33:mount.lustre.0 Request processed in 808us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907095.515773:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:1.0:1787907095.515909:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972086912 00000100:00100000:1.0:1787907095.515917:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972086912 00000100:00100000:1.0:1787907095.515957:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:1.0:1787907095.515963:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2342:x1874755972086912:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787907095.515996:0:15061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7105112f-1b7f-4c1e-bd83-6e301c02c68b@192.168.204.20@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1787907095.516036:0:15061:0:(genops.c:1385:class_connect()) connect: client 7105112f-1b7f-4c1e-bd83-6e301c02c68b, cookie 0x72bb6cf063cae677 00002000:00100000:1.0:1787907095.516053:0:15061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7105112f-1b7f-4c1e-bd83-6e301c02c68b/ffff8aa51a7e4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787907095.516069:0:15061:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787907095.516323:0:15061:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787907095.516364:0:15061:0:(import.c:65:import_set_state_nolock()) ffff8aa510325000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787907095.516407:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:2342:x1874755972086912:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 443us (2812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907095.516415:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:0.0:1787907095.707764:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907095.708144:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972087168 00000100:00100000:2.0:1787907095.708160:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972087168 00000100:00100000:2.0:1787907095.708246:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:2.0:1787907095.708259:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:13923:x1874755972087168:12345-192.168.204.20@tcp:101:mkdir.0 00010000:00010000:2.0:1787907095.708287:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907095.708316:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1e00/0x72bb6cf063cae67e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efaa8 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907095.708418:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1c00/0x72bb6cf063cae685 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907095.708434:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1c00/0x72bb6cf063cae685 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907095.708450:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1c00/0x72bb6cf063cae685 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787907095.709041:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787907095.710178:0:14377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787907095.710426:0:14377:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1c00/0x72bb6cf063cae685 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907095.710706:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1e00/0x72bb6cf063cae67e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaa8 expref: 8 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907095.710748:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1c00/0x72bb6cf063cae685 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaa8 expref: 7 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907095.710760:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:2.0:1787907095.710763:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787907095.710767:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd1c00, rc 0) 00000100:00100000:2.0:1787907095.711013:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7105112f-1b7f-4c1e-bd83-6e301c02c68b+7:13923:x1874755972087168:12345-192.168.204.20@tcp:101:mkdir.0 Request processed in 2755us (3263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907095.711026:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00010000:00010000:3.0:1787907095.968172:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907096.998450:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787907097.248989:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787907097.249024:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000393472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787907097.249124:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907097.249199:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000393472 00000100:00100000:2.0:1787907097.249211:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000393472 00000100:00100000:2.0:1787907097.249308:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787907097.249321:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000393472:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787907097.249631:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787907097.249788:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787907097.249900:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000393472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 580us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907097.249909:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787907097.250323:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000393472:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787907097.361383:0:6699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7105112f-1b7f-4c1e-bd83-6e301c02c68b 00000001:00100000:2.0:1787907097.361410:0:6699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b3584eb2-bb70-4147-abd7-b7e752b5bc9e 00000100:00100000:1.0:1787907097.763129:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000393856:0@lo:400:kworker.0 00000100:00100000:1.0:1787907097.763343:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907097.763450:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787907097.763458:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000393984:0@lo:400:kworker.0 00000100:00100000:1.0:1787907097.763495:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907097.763554:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000393856 00000100:00100000:1.0:1787907097.763567:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000393856 00000100:00100000:1.0:1787907097.763706:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787907097.763715:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000393600:0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.763771:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907097.763807:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000394112:0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.763870:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907097.763903:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787907097.763910:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000393728:0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.763937:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907097.763955:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000394240:0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.763977:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907097.764002:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787907097.764011:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000394368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787907097.764038:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907097.764069:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000393984 00000100:00100000:2.0:1787907097.764074:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000393984 00000100:00100000:2.0:1787907097.764102:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000394112 00000100:00100000:2.0:1787907097.764105:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000394112 00000100:00100000:2.0:1787907097.764120:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000394240 00000100:00100000:2.0:1787907097.764122:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000394240 00000100:00100000:2.0:1787907097.764138:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787907097.764148:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000393984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.764210:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000393984:12345-0@lo:400:kworker.0 Request processed in 63us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907097.764219:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787907097.764242:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787907097.764248:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000394112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.764282:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000394112:12345-0@lo:400:kworker.0 Request processed in 35us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907097.764288:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787907097.764301:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787907097.764308:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000394240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.764334:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000394240:12345-0@lo:400:kworker.0 Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907097.764350:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787907097.764372:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000393600 00000100:00100000:2.0:1787907097.764376:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000393600 00000100:00100000:2.0:1787907097.764404:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787907097.764412:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3303:x1874756000393600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.764448:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3303:x1874756000393600:12345-0@lo:400:kworker.0 Request processed in 37us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907097.764461:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787907097.764461:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000393856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.764504:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787907097.764511:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000393856:12345-0@lo:400:kworker.0 Request processed in 58us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907097.764529:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787907097.764535:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787907097.764552:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000393728 00000100:00100000:1.0:1787907097.764555:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000393728 00000100:00100000:2.0:1787907097.764561:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000394368 00000100:00100000:2.0:1787907097.764567:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000394368 00000100:00100000:1.0:1787907097.764576:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787907097.764585:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000393728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.764601:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787907097.764612:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000394368:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787907097.764620:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000393728:12345-0@lo:400:kworker.0 Request processed in 36us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907097.764628:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00002000:00000024:2.0:1787907097.764644:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787907097.764689:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000394368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907097.764697:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787907097.764744:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787907097.764778:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000394368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787907097.764809:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000393728:0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.764847:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000394240:0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.764859:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000393600:0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.764871:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000394112:0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.764930:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000393984:0@lo:400:kworker.0 00000100:00100000:2.0:1787907097.764941:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000393856:0@lo:400:kworker.0 00000100:00080000:1.0:1787907097.768593:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787907097.768607:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1787907097.860353:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b3584eb2-bb70-4147-abd7-b7e752b5bc9e 00000001:00100000:3.0:1787907097.860379:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7105112f-1b7f-4c1e-bd83-6e301c02c68b 00000001:00100000:1.0:1787907097.878859:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7105112f-1b7f-4c1e-bd83-6e301c02c68b 00010000:00010000:1.0:1787907098.023593:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907099.047387:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787907099.459522:0:16339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787907100.065914:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787907100.707658:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907100.707713:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907100.707721:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972087296 00000100:00100000:3.0:1787907100.707735:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972087296 00000100:00100000:2.0:1787907100.707759:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907100.707779:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907100.707800:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907100.707802:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 103 00000100:00100000:2.0:1787907100.707841:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907100.707842:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:2346:x1874755972087296:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787907100.707871:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907100.707896:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972087552 00000100:00100000:2.0:1787907100.707900:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972087552 00000100:00100000:2.0:1787907100.707941:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972088064 00000100:00100000:2.0:1787907100.707944:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972088064 00000100:00100000:3.0:1787907100.707955:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:2346:x1874755972087296:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 142us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907100.707961:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972087680 00000100:00100000:2.0:1787907100.707963:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972087680 00000100:00100000:3.0:1787907100.707964:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 103 00000100:00100000:2.0:1787907100.707974:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972087936 00000100:00100000:2.0:1787907100.707976:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972087936 00000100:00100000:2.0:1787907100.707990:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:2.0:1787907100.707997:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+5:2346:x1874755972087552:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787907100.708546:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+5:2346:x1874755972087552:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 545us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907100.708555:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:2.0:1787907100.708578:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:2.0:1787907100.708585:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7105112f-1b7f-4c1e-bd83-6e301c02c68b+5:2346:x1874755972088064:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787907100.708617:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7105112f-1b7f-4c1e-bd83-6e301c02c68b+5:2346:x1874755972088064:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 33us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907100.708642:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:2.0:1787907100.708655:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:2.0:1787907100.708662:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+5:2346:x1874755972087680:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787907100.708688:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+5:2346:x1874755972087680:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907100.708694:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:2.0:1787907100.708704:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:2.0:1787907100.708710:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7105112f-1b7f-4c1e-bd83-6e301c02c68b+5:2346:x1874755972087936:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787907100.710336:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7105112f-1b7f-4c1e-bd83-6e301c02c68b+5:2346:x1874755972087936:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 1615us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907100.710350:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:2.0:1787907100.710391:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972087808 00000100:00100000:2.0:1787907100.710399:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972087808 00000100:00100000:2.0:1787907100.710443:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972087424 00000100:00100000:2.0:1787907100.710446:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972087424 00000100:00100000:2.0:1787907100.710477:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1787907100.710485:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:2346:x1874755972087808:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787907100.710515:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:2346:x1874755972087808:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 32us (2756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907100.710522:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1787907100.710533:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:2.0:1787907100.710539:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:2346:x1874755972087424:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787907100.710561:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:2346:x1874755972087424:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (2761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907100.710576:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00080000:1.0:1787907100.712941:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787907100.712950:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787907100.712953:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787907101.089009:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907102.112115:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787907102.371917:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000394496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787907102.371997:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907102.372075:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000394496 00000100:00100000:2.0:1787907102.372082:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000394496 00000100:00100000:2.0:1787907102.372172:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787907102.372184:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000394496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787907102.372226:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787907102.372288:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000394496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907102.372296:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787907102.372352:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000394496:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787907102.373542:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787907102.881211:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000394624:0@lo:400:kworker.0 00000100:00100000:2.0:1787907102.881294:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907102.881343:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000395136:0@lo:400:kworker.0 00000100:00100000:2.0:1787907102.881371:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907102.881398:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787907102.881404:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000394752:0@lo:400:kworker.0 00000100:00100000:2.0:1787907102.881439:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907102.881457:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000395264:0@lo:400:kworker.0 00000100:00100000:2.0:1787907102.881478:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907102.881510:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f78b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000394880:0@lo:400:kworker.0 00000100:00100000:2.0:1787907102.881532:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907102.881549:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000395392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787907102.881593:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907102.881611:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787907102.881616:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000395008:0@lo:400:kworker.0 00000100:00100000:2.0:1787907102.881636:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907102.881667:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000394624 00000100:00100000:2.0:1787907102.881674:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000394624 00000100:00100000:2.0:1787907102.881718:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787907102.881727:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3303:x1874756000394624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907102.881777:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3303:x1874756000394624:12345-0@lo:400:kworker.0 Request processed in 51us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907102.881784:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787907102.881836:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000395136 00000100:00100000:2.0:1787907102.881841:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000395136 00000100:00100000:0.0:1787907102.886581:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000395264 00000100:00100000:0.0:1787907102.886602:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000395264 00000100:00100000:3.0:1787907102.891622:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000394752 00000100:00100000:3.0:1787907102.891640:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000394752 00000100:00100000:3.0:1787907102.891708:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000394880 00000100:00100000:3.0:1787907102.891711:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000394880 00000100:00100000:2.0:1787907102.891807:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787907102.891833:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000394752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907102.891927:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000394752:12345-0@lo:400:kworker.0 Request processed in 98us (10487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907102.891935:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787907102.892084:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000395008 00000100:00100000:2.0:1787907102.892088:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000395008 00000100:00100000:2.0:1787907102.892104:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787907102.892111:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000395136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907102.892145:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000395136:12345-0@lo:400:kworker.0 Request processed in 35us (10774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907102.892151:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787907102.892164:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787907102.892171:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000395008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907102.892233:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000395008:12345-0@lo:400:kworker.0 Request processed in 62us (10595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907102.892239:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787907102.892282:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000395008:0@lo:400:kworker.0 00000100:00100000:2.0:1787907102.892374:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000395392 00000100:00100000:2.0:1787907102.892379:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000395392 00000100:00100000:2.0:1787907102.892403:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787907102.892410:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874756000395392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787907102.892447:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787907102.892484:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874756000395392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (10890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907102.892489:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787907102.892520:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000395392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787907102.893706:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787907102.893717:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000395264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907102.893777:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000395264:12345-0@lo:400:kworker.0 Request processed in 62us (12297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907102.893783:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787907102.893874:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787907102.893880:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787907102.895276:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000394752:0@lo:400:kworker.0 00000100:00100000:2.0:1787907102.895304:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000395264:0@lo:400:kworker.0 00000100:00100000:2.0:1787907102.895320:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000394624:0@lo:400:kworker.0 00000100:00100000:2.0:1787907102.895334:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000395136:0@lo:400:kworker.0 00000100:00100000:3.0:1787907102.899123:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787907102.899142:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000394880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787907102.899278:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874756000394880:12345-0@lo:400:kworker.0 Request processed in 142us (17744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907102.899287:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787907102.899341:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f78b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874756000394880:0@lo:400:kworker.0 00010000:00010000:2.0:1787907103.136146:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787907103.591069:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1787907103.772015:0:16487:0:(class_obd.c:354:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe337a87b0 20000000:00000080:0.0:1787907103.772047:0:16487:0:(mgs_handler.c:1205:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8aa40308e800 uarg=0000000000000000 20000000:01000000:0.0:1787907103.772105:0:16487:0:(mgs_llog.c:6200:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787907103.772113:0:16487:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787907103.772119:0:16487:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787907103.773289:0:16488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787907103.773581:0:16487:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787907103.787133:0:16487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787907103.787167:0:16487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907103.787186:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa53ac8e600/0x72bb6cf063cae383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae37c expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907103.787193:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae3d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae3c9 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907103.787215:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa508210600/0x72bb6cf063cae50b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae504 expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907103.787224:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa403746a00/0x72bb6cf063cae62a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa1c expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907103.787231:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa50efd0000/0x72bb6cf063cae662 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa7e expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907103.787237:0:16487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907103.787288:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa50efd0000/0x72bb6cf063cae662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa7e expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907103.787307:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa50efd0000/0x72bb6cf063cae662 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa7e expref: 12 pid: 14372 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907103.787325:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874756000395520:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787907103.787454:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa403746a00/0x72bb6cf063cae62a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa1c expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907103.787462:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa403746a00/0x72bb6cf063cae62a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa1c expref: 12 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907103.787471:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cc8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874756000395648:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787907103.787504:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa508210600/0x72bb6cf063cae50b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cae504 expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907103.787521:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa508210600/0x72bb6cf063cae50b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cae504 expref: 18 pid: 14369 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907103.787531:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874756000395776:0@lo:104: 00000100:00100000:0.0:1787907103.787575:0:16487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787907103.787624:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae3d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cae3c9 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907103.787633:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae3d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cae3c9 expref: 18 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907103.787641:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874756000395904:0@lo:104: 00000100:00100000:3.0:1787907103.787885:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000395776 00000100:00100000:3.0:1787907103.787895:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000395776 00000100:00100000:3.0:1787907103.787969:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787907103.787981:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ebba1202-2d0e-4d1e-8963-43f853425a20+3:16487:x1874756000395776:12345-0@lo:104: 00010000:00010000:3.0:1787907103.788004:0:14360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cae50b expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.788065:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787907103.788072:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ebba1202-2d0e-4d1e-8963-43f853425a20+3:16487:x1874756000395776:12345-0@lo:104: Request processed in 93us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907103.788079:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787907103.788104:0:15545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907103.788110:0:15545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cae50b expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.788118:0:15545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd0c00 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787907103.788122:0:15545:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cae50b expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.788130:0:15545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cae50b expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787907103.788137:0:15545:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cae50b expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787907103.788143:0:15545:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787907103.788174:0:15545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae50b expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.788181:0:15545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787907103.788199:0:15545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae50b expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.788206:0:15545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa50efd0c00/0x72bb6cf063cae504 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae50b expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.788223:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907103.788225:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907103.788226:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787907103.788247:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ebba1202-2d0e-4d1e-8963-43f853425a20:3302:1874756000396032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787907103.788277:0:16487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907103.788301:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907103.788354:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000396032 00000100:00100000:3.0:1787907103.788358:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000396032 00010000:00010000:3.0:1787907103.788376:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa508210600/0x72bb6cf063cae50b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cae504 expref: 19 pid: 14369 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907103.788400:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787907103.788428:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508203800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3302:x1874756000396032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787907103.788438:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787907103.788443:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa508210600/0x72bb6cf063cae50b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cae504 expref: 19 pid: 14369 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.788453:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa508210600/0x72bb6cf063cae50b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cae504 expref: 19 pid: 14369 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.788468:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787907103.788504:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa53ac8e600/0x72bb6cf063cae383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bb6cf063cae37c expref: 19 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907103.788514:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa53ac8e600/0x72bb6cf063cae383 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bb6cf063cae37c expref: 19 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907103.788523:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874756000396160:0@lo:104: 00000100:00100000:1.0:1787907103.788538:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000395904 00000100:00100000:1.0:1787907103.788544:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000395904 00000100:00100000:1.0:1787907103.788570:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787907103.788577:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ebba1202-2d0e-4d1e-8963-43f853425a20+3:16487:x1874756000395904:12345-0@lo:104: 00010000:00010000:1.0:1787907103.788586:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cae3d0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907103.790430:0:16487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907103.790464:0:16487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534d66b40 going to sleep for 11 seconds 00010000:00010000:0.0:1787907103.790493:0:16487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa508210600/0x72bb6cf063cae50b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cae504 expref: 19 pid: 14369 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907103.790508:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874756000395776:0@lo:104: 00000100:00100000:2.0:1787907103.790571:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787907103.790587:0:14360:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787907103.790593:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1787907103.790854:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787907103.790877:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ebba1202-2d0e-4d1e-8963-43f853425a20+3:16487:x1874756000395904:12345-0@lo:104: Request processed in 2298us (2598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907103.790887:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787907103.790911:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000396160 00000100:00100000:1.0:1787907103.790919:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000396160 00000100:00100000:1.0:1787907103.790950:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787907103.790959:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa541c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ebba1202-2d0e-4d1e-8963-43f853425a20+3:16487:x1874756000396160:12345-0@lo:104: 00010000:00010000:1.0:1787907103.790976:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cae383 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907103.791022:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787907103.791028:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa541c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ebba1202-2d0e-4d1e-8963-43f853425a20+3:16487:x1874756000396160:12345-0@lo:104: Request processed in 70us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907103.791030:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508203800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ebba1202-2d0e-4d1e-8963-43f853425a20+18:3302:x1874756000396032:12345-0@lo:103:ldlm_bl.0 Request processed in 2602us (2729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907103.791034:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787907103.791039:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787907103.791063:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787907103.791069:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cae3d0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.791077:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa500031600 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787907103.791089:0:14366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cae3d0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.791099:0:14366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cae3d0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787907103.791107:0:14366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cae3d0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787907103.791113:0:14366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787907103.791155:0:14366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae3d0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.791161:0:14366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787907103.791183:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae3d0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.791189:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa500031600/0x72bb6cf063cae3c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae3d0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.791200:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907103.791203:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bb6cf063cae383 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.791209:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa541c96200 already unused, calling callback (ffffffffc1a56c20) 10000000:00010000:3.0:1787907103.791212:0:14366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bb6cf063cae383 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.791218:0:14366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bb6cf063cae383 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787907103.791235:0:14366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bb6cf063cae383 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787907103.791241:0:14366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787907103.791594:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907103.791932:0:14366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae383 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.791940:0:14366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787907103.791949:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae383 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.791956:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8aa541c96200/0x72bb6cf063cae37c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bb6cf063cae383 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.791970:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907103.791971:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907103.791973:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787907103.791988:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000396288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787907103.792034:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907103.792063:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787907103.792068:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000396416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787907103.792090:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907103.792122:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000396288 00000100:00100000:3.0:1787907103.792128:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000396288 00010000:00010000:3.0:1787907103.792149:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae3d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cae3c9 expref: 18 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907103.792170:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000396416 00000100:00100000:3.0:1787907103.792173:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000396416 00010000:00010000:3.0:1787907103.792196:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa53ac8e600/0x72bb6cf063cae383 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cae37c expref: 19 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907103.792210:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787907103.792218:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508202680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3303:x1874756000396288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787907103.792229:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787907103.792234:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae3d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cae3c9 expref: 19 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.792245:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae3d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cae3c9 expref: 19 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.793330:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787907103.793386:0:16487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa508210000/0x72bb6cf063cae3d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cae3c9 expref: 19 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907103.793387:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508202680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3303:x1874756000396288:12345-0@lo:103:ldlm_bl.0 Request processed in 1170us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907103.793396:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787907103.793424:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874756000395904:0@lo:104: 00000100:00100000:3.0:1787907103.793428:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787907103.793435:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5062b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ebba1202-2d0e-4d1e-8963-43f853425a20+17:3303:x1874756000396416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787907103.793445:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787907103.793450:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa53ac8e600/0x72bb6cf063cae383 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bb6cf063cae37c expref: 17 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.793458:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa53ac8e600/0x72bb6cf063cae383 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bb6cf063cae37c expref: 17 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.793469:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787907103.793503:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5062b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ebba1202-2d0e-4d1e-8963-43f853425a20+17:3303:x1874756000396416:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907103.793510:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787907103.793589:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ebba1202-2d0e-4d1e-8963-43f853425a20:3302:1874756000396032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787907103.793596:0:16487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa53ac8e600/0x72bb6cf063cae383 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bb6cf063cae37c expref: 16 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907103.793604:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874756000396160:0@lo:104: 00000100:00100000:0.0:1787907103.793675:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000396416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787907103.793697:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000396288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787907103.808107:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907103.808141:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907103.808197:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874756000395520:192.168.204.20@tcp:104: 00000100:00100000:2.0:1787907103.808213:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cc8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874756000395648:192.168.204.20@tcp:104: 00010000:00010000:2.0:1787907103.808250:0:16487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907103.808314:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972088192 00000100:00100000:3.0:1787907103.808323:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972088192 00010000:00010000:3.0:1787907103.808365:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa50efd0000/0x72bb6cf063cae662 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa7e expref: 13 pid: 14372 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907103.808419:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972088320 00000100:00100000:3.0:1787907103.808423:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972088320 00010000:00010000:3.0:1787907103.808437:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa403746a00/0x72bb6cf063cae62a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa1c expref: 14 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907103.808451:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1787907103.808460:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf71194-8f86-474c-b7fd-37f1c612ad57+14:2345:x1874755972088192:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787907103.808474:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787907103.808490:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa50efd0000/0x72bb6cf063cae662 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa7e expref: 14 pid: 14372 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808503:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa50efd0000/0x72bb6cf063cae662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa7e expref: 14 pid: 14372 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808521:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa50efd0000/0x72bb6cf063cae662 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa7e expref: 14 pid: 14372 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808534:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787907103.808599:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:2345:x1874755972088192:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 139us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907103.808606:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1787907103.808624:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:3.0:1787907103.808630:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf71194-8f86-474c-b7fd-37f1c612ad57+12:2345:x1874755972088320:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787907103.808650:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787907103.808656:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa403746a00/0x72bb6cf063cae62a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa1c expref: 12 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808664:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa403746a00/0x72bb6cf063cae62a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa1c expref: 12 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808674:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa403746a00/0x72bb6cf063cae62a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa1c expref: 12 pid: 14371 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808684:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808692:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808707:0:14364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808714:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808721:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808728:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808734:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403747e00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907103.808738:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808758:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808779:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907103.808788:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787907103.808809:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf71194-8f86-474c-b7fd-37f1c612ad57+11:2345:x1874755972088320:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 179us (667us total) trans 0 rc 0/0 00010000:00010000:2.0:1787907103.809080:0:16487:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907103.809088:0:16487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907103.809095:0:16487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae68c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907103.809330:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00010000:00010000:3.0:1787907104.163702:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787907105.058002:0:14374:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787907105.058015:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa51a7e0800 from 10 10000000:01000000:3.0:1787907105.058021:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787907105.058075:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511994400/0x72bb6cf063cae693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907105.058088:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa511994400/0x72bb6cf063cae693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907105.058100:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa511994400/0x72bb6cf063cae693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907105.058127:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508201f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000396544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787907105.058204:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907105.058279:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787907105.058353:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000396544 00000100:00100000:0.0:1787907105.058362:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000396544 00000100:00100000:0.0:1787907105.058433:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787907105.058444:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+16:14374:x1874756000396544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787907105.058458:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907105.058474:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa403746000/0x72bb6cf063cae69a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae693 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907105.058499:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa403746000/0x72bb6cf063cae69a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae693 expref: 17 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907105.058511:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa403746000/0x72bb6cf063cae69a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae693 expref: 17 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907105.058521:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa403746000, rc 0) 00000100:00100000:0.0:1787907105.058699:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+17:14374:x1874756000396544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 257us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907105.058707:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787907105.058791:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508201f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000396544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787907105.058805:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa511994400/0x72bb6cf063cae693 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae69a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907105.058839:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa511994400/0x72bb6cf063cae693 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae69a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907105.058903:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508201f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000396672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787907105.058925:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907105.058945:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787907105.059056:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000396672 00000100:00100000:0.0:1787907105.059060:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000396672 00000100:00100000:0.0:1787907105.059086:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787907105.059093:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+17:14374:x1874756000396672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787907105.059351:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+17:14374:x1874756000396672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907105.059367:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787907105.059407:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508201f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000396672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787907105.059433:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa535e8a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000396800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787907105.059466:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907105.059484:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534d66c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787907105.059493:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000396800 00000100:00100000:0.0:1787907105.059496:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000396800 00000100:00100000:0.0:1787907105.059510:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787907105.059516:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+17:14374:x1874756000396800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787907105.065079:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+17:14374:x1874756000396800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5549us (5598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907105.065096:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787907105.065105:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa535e8a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000396800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787907105.073094:0:16520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787907105.073515:0:14374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787907105.073541:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787907105.073555:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa511994400/0x72bb6cf063cae693 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae69a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907105.073567:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa511994400/0x72bb6cf063cae693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae69a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787907105.073579:0:14374:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787907105.073583:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa5131e2000 from 10 10000000:01000000:1.0:1787907105.073586:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787907105.073642:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb400/0x72bb6cf063cae6a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907105.073669:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb400/0x72bb6cf063cae6a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907105.073683:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb400/0x72bb6cf063cae6a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907105.073726:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000396928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787907105.073797:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907105.073873:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5072056c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787907105.074132:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000396928 00000100:00100000:0.0:1787907105.074142:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000396928 00000100:00100000:0.0:1787907105.074208:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787907105.074221:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+17:14374:x1874756000396928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787907105.074252:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907105.074268:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae6a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae6a1 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907105.074298:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae6a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae6a1 expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907105.074310:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa403747e00/0x72bb6cf063cae6a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae6a1 expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907105.074333:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa403747e00, rc 0) 00000100:00100000:0.0:1787907105.074395:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+18:14374:x1874756000396928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907105.074403:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787907105.075988:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000396928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787907105.076015:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb400/0x72bb6cf063cae6a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae6a8 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907105.076028:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb400/0x72bb6cf063cae6a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae6a8 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907105.076111:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508203800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000397056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787907105.076171:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907105.076221:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787907105.076527:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000397056 00000100:00100000:1.0:1787907105.076534:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000397056 00000100:00100000:1.0:1787907105.076583:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787907105.076592:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+18:14374:x1874756000397056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787907105.078122:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+18:14374:x1874756000397056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1522us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907105.078136:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787907105.079661:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508203800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000397056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787907105.079751:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa508203800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000397184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787907105.079876:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907105.080016:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000397184 00000100:00100000:2.0:1787907105.080024:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000397184 00000100:00100000:2.0:1787907105.080089:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787907105.080101:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+18:14374:x1874756000397184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787907105.081733:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa502bd9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787907105.082010:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+18:14374:x1874756000397184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1909us (2140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907105.082023:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787907105.082625:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa508203800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000397184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787907105.086319:0:16522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787907105.086679:0:14374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787907105.086706:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787907105.086718:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb400/0x72bb6cf063cae6a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae6a8 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907105.086730:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa5421fb400/0x72bb6cf063cae6a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae6a8 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787907105.086741:0:14374:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787907105.086744:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8aa52f19c000 from 10 10000000:01000000:2.0:1787907105.086747:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787907105.086793:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa50efd1600/0x72bb6cf063cae6af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907105.086801:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8aa50efd1600/0x72bb6cf063cae6af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907105.086838:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8aa50efd1600/0x72bb6cf063cae6af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907105.086872:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000397312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787907105.087009:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907105.087061:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787907105.087133:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000397312 00000100:00100000:1.0:1787907105.087142:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000397312 00000100:00100000:1.0:1787907105.087196:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787907105.087207:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+18:14374:x1874756000397312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787907105.087224:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907105.087254:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa5421fbc00/0x72bb6cf063cae6b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bb6cf063cae6af expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907105.087285:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa5421fbc00/0x72bb6cf063cae6b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bb6cf063cae6af expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907105.087316:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa5421fbc00/0x72bb6cf063cae6b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bb6cf063cae6af expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907105.087327:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa5421fbc00, rc 0) 00000100:00100000:1.0:1787907105.087399:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+19:14374:x1874756000397312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907105.087407:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787907105.087431:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000397312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787907105.087446:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8aa50efd1600/0x72bb6cf063cae6af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae6b6 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907105.087456:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8aa50efd1600/0x72bb6cf063cae6af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bb6cf063cae6b6 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907105.087522:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000397440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787907105.087547:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907105.087575:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787907105.087584:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000397440 00000100:00100000:1.0:1787907105.087588:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000397440 00000100:00100000:1.0:1787907105.087618:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787907105.087625:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+19:14374:x1874756000397440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787907105.087917:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+19:14374:x1874756000397440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907105.087924:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787907105.088143:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000397440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787907105.088175:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000397568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787907105.088210:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907105.088238:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534a296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787907105.088649:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000397568 00000100:00100000:1.0:1787907105.088655:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000397568 00000100:00100000:1.0:1787907105.088694:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787907105.088772:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536c17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+19:14374:x1874756000397568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787907105.090090:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536c17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ebba1202-2d0e-4d1e-8963-43f853425a20+19:14374:x1874756000397568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1383us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907105.090103:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787907105.090220:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ebba1202-2d0e-4d1e-8963-43f853425a20:14374:1874756000397568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787907105.095644:0:16523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787907105.096883:0:14374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787907105.096933:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787907105.096947:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8aa50efd1600/0x72bb6cf063cae6af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae6b6 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907105.096962:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8aa50efd1600/0x72bb6cf063cae6af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bb6cf063cae6b6 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907105.185183:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787907105.356046:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907105.356093:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972088448 00000100:00100000:3.0:1787907105.356107:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972088448 00000100:00100000:3.0:1787907105.356181:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:3.0:1787907105.356194:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+11:13778:x1874755972088448:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787907105.356217:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907105.359219:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa50efd1400/0x72bb6cf063cae6bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efaaf expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907105.359281:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa50efd1400/0x72bb6cf063cae6bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaaf expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907105.359301:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa50efd1400/0x72bb6cf063cae6bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaaf expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907105.359314:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd1400, rc 0) 00000100:00100000:2.0:1787907105.359445:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+12:13778:x1874755972088448:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 3252us (3414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907105.359477:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:3.0:1787907105.361940:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907105.362089:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972088576 00000100:00100000:2.0:1787907105.362105:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972088576 00000100:00100000:2.0:1787907105.362185:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:2.0:1787907105.362202:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+12:13778:x1874755972088576:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787907105.362757:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+12:13778:x1874755972088576:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 558us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907105.362766:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:3.0:1787907105.372665:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907105.372768:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972088704 00000100:00100000:0.0:1787907105.372780:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972088704 00000100:00100000:0.0:1787907105.372878:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:0.0:1787907105.372891:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+12:13778:x1874755972088704:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787907105.373195:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+12:13778:x1874755972088704:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 306us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907105.373206:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:2.0:1787907105.398995:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907105.402053:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972088832 00000100:00100000:1.0:1787907105.402074:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972088832 00000100:00100000:1.0:1787907105.402153:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:1.0:1787907105.402165:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+12:13778:x1874755972088832:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787907105.402195:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907105.402217:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa5421fa600/0x72bb6cf063cae6c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efab6 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907105.402250:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa5421fa600/0x72bb6cf063cae6c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efab6 expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907105.402262:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa5421fa600/0x72bb6cf063cae6c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efab6 expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907105.402272:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa5421fa600, rc 0) 00000100:00100000:1.0:1787907105.402383:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:13778:x1874755972088832:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 205us (3387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907105.402392:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:2.0:1787907105.408507:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907105.408728:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972088960 00000100:00100000:3.0:1787907105.408745:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972088960 00000100:00100000:3.0:1787907105.409085:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:3.0:1787907105.409101:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:13778:x1874755972088960:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787907105.409517:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:13778:x1874755972088960:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 419us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907105.409525:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:2.0:1787907105.425868:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907105.425933:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972089088 00000100:00100000:3.0:1787907105.425943:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972089088 00000100:00100000:3.0:1787907105.425997:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:3.0:1787907105.426018:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:13778:x1874755972089088:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787907105.426244:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:13778:x1874755972089088:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 237us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907105.426252:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:1.0:1787907105.807399:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907105.807452:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907105.807527:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972089216 00000100:00100000:0.0:1787907105.807537:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972089216 00000100:00100000:0.0:1787907105.807611:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:0.0:1787907105.807624:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:2343:x1874755972089216:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787907105.807703:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:2343:x1874755972089216:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 82us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907105.807710:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00080000:1.0:1787907105.807771:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787907105.812554:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972089344 00000100:00100000:2.0:1787907105.812579:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972089344 00000100:00100000:2.0:1787907105.812700:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1787907105.812717:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+5:2343:x1874755972089344:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787907105.812839:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+5:2343:x1874755972089344:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 127us (5385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907105.812846:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00080000:1.0:1787907105.812909:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787907105.813267:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907105.813408:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907105.813529:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907105.813553:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972089856 00000100:00100000:0.0:1787907105.813559:0:16300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972089856 00000100:00100000:0.0:1787907105.813592:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972089472 00000100:00100000:0.0:1787907105.813595:0:16300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972089472 00000100:00100000:0.0:1787907105.813635:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:0.0:1787907105.813643:0:16300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7105112f-1b7f-4c1e-bd83-6e301c02c68b+5:2344:x1874755972089856:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787907105.813686:0:16300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7105112f-1b7f-4c1e-bd83-6e301c02c68b+5:2344:x1874755972089856:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 44us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907105.813692:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:0.0:1787907105.813705:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:0.0:1787907105.813712:0:16300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+5:2344:x1874755972089472:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787907105.813736:0:16300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+5:2344:x1874755972089472:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907105.813741:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00080000:0.0:1787907105.813759:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787907105.813782:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907105.813797:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972089728 00000100:00100000:0.0:1787907105.813801:0:16300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972089728 00000100:00100000:0.0:1787907105.813848:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:0.0:1787907105.813855:0:16300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7105112f-1b7f-4c1e-bd83-6e301c02c68b+5:2344:x1874755972089728:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787907105.813882:0:16300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7105112f-1b7f-4c1e-bd83-6e301c02c68b+5:2344:x1874755972089728:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907105.813888:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00080000:0.0:1787907105.813901:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787907105.818140:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972089600 00000100:00100000:1.0:1787907105.818163:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972089600 00000100:00100000:1.0:1787907105.818306:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:1.0:1787907105.818318:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa535e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:2344:x1874755972089600:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1787907105.818425:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa535e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:2344:x1874755972089600:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 109us (5158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907105.818433:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00080000:3.0:1787907105.818699:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787907106.209192:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907107.232115:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787907107.488439:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787907107.488477:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa4037a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000397696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787907107.488601:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907107.488923:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000397696 00000100:00100000:1.0:1787907107.488932:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000397696 00000100:00100000:1.0:1787907107.489019:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787907107.489029:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000397696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787907107.489067:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787907107.489131:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000397696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907107.489138:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787907107.489207:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa4037a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000397696:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787907107.489426:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787907107.819049:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907107.827025:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972089984 00000100:00100000:0.0:1787907107.827048:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972089984 00000100:00100000:0.0:1787907107.827242:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:0.0:1787907107.827268:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa4037a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:14435:x1874755972089984:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787907107.827312:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907107.827354:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae6cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efabd expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.827455:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae6d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.827474:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae6d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.827488:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae6d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.827503:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae6d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.827509:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.827526:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828102:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746600/0x72bb6cf063cae6e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828114:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746600/0x72bb6cf063cae6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828120:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746600/0x72bb6cf063cae6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787907107.828225:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787907107.828230:0:14377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787907107.828357:0:14377:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746600/0x72bb6cf063cae6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828371:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae6d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828378:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae6d2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828385:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae6d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828392:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403746c00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787907107.828396:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae6d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828404:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae6d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828420:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:0.0:1787907107.828423:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787907107.828429:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae6d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828436:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae6d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828450:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828465:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae6d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828471:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae6d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828477:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403747c00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787907107.828481:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae6d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828486:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae6d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828496:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8aa50a6b4000) 00010000:00010000:0.0:1787907107.828498:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787907107.828501:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae6d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828505:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae6d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828552:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae6cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efabd expref: 8 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828568:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746600/0x72bb6cf063cae6e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efabd expref: 7 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.828576:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8aa50a6b4800) 00010000:00010000:0.0:1787907107.828578:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787907107.828587:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa403746600, rc 0) 00000100:00100000:0.0:1787907107.828674:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa4037a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:14435:x1874755972089984:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1417us (9634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907107.828685:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00080000:3.0:1787907107.834641:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787907107.837492:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907107.837668:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972090240 00000100:00100000:0.0:1787907107.837679:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972090240 00000100:00100000:0.0:1787907107.837888:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:0.0:1787907107.837901:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:14435:x1874755972090240:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787907107.837928:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907107.837955:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747000/0x72bb6cf063cae6e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efac4 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.838057:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747a00/0x72bb6cf063cae6ee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.838073:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747a00/0x72bb6cf063cae6ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.838085:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747a00/0x72bb6cf063cae6ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.838585:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746400/0x72bb6cf063cae6f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.838595:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746400/0x72bb6cf063cae6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.838603:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746400/0x72bb6cf063cae6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.844153:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fbe00/0x72bb6cf063cae6fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.844177:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fbe00/0x72bb6cf063cae6fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.844190:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fbe00/0x72bb6cf063cae6fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787907107.844205:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787907107.851283:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747a00/0x72bb6cf063cae6ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.851303:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747a00/0x72bb6cf063cae6ee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.851311:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747a00/0x72bb6cf063cae6ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.851318:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403747a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907107.851597:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747a00/0x72bb6cf063cae6ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.851626:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747a00/0x72bb6cf063cae6ee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.851649:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8aa50a6b4800) 00010000:00010000:1.0:1787907107.851662:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907107.851668:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747a00/0x72bb6cf063cae6ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.851674:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747a00/0x72bb6cf063cae6ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.851694:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746400/0x72bb6cf063cae6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.851700:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746400/0x72bb6cf063cae6f5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.851706:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746400/0x72bb6cf063cae6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.851711:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403746400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907107.851714:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746400/0x72bb6cf063cae6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.851719:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746400/0x72bb6cf063cae6f5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.851736:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8aa50a6b4500) 00010000:00010000:1.0:1787907107.851739:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907107.851742:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746400/0x72bb6cf063cae6f5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.851757:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746400/0x72bb6cf063cae6f5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.852417:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747000/0x72bb6cf063cae6e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efac4 expref: 10 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.852438:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fbe00/0x72bb6cf063cae6fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efac4 expref: 9 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.852446:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa504dd3f00) 00010000:00010000:1.0:1787907107.852448:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907107.852450:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa5421fbe00, rc 0) 00000100:00100000:1.0:1787907107.855597:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+9:14435:x1874755972090240:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 17682us (18099us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787907107.855613:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:2.0:1787907107.877514:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907107.884751:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972090368 00000100:00100000:1.0:1787907107.884771:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972090368 00000100:00100000:2.0:1787907107.885256:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1787907107.885268:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+9:14435:x1874755972090368:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787907107.885400:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+9:14435:x1874755972090368:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 Request processed in 134us (7895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907107.885428:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1787907107.932254:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907107.934158:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972090496 00000100:00100000:1.0:1787907107.934176:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972090496 00000100:00100000:1.0:1787907107.934280:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:1.0:1787907107.934296:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+9:14441:x1874755972090496:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1787907107.934334:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907107.934365:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae70a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efacb expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.934447:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae711 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.934485:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae711 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.934497:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae711 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.934526:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae718 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.934535:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.934541:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935231:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae711 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935249:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae711 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935257:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae711 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935264:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fac00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787907107.935269:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae711 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935278:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae711 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935293:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:0.0:1787907107.935296:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787907107.935301:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935306:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935333:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935340:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae718 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935346:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935351:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fba00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787907107.935361:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935368:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae718 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935376:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8aa504dd3d00) 00010000:00010000:0.0:1787907107.935378:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787907107.935381:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae718 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935387:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae718 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935431:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae70a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efacb expref: 10 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935441:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:0.0:1787907107.935443:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787907107.935447:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae70a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efacb expref: 10 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.935457:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa5421faa00, rc 0) 00000100:00100000:0.0:1787907107.935538:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+9:14441:x1874755972090496:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1245us (3300us total) trans 0 rc 301/301 00000100:00100000:0.0:1787907107.935546:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:1.0:1787907107.941075:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907107.941195:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972090624 00000100:00100000:0.0:1787907107.941211:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972090624 00000100:00100000:0.0:1787907107.941277:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:0.0:1787907107.941294:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+9:14441:x1874755972090624:12345-192.168.204.20@tcp:700:lfs.0 00000100:00100000:0.0:1787907107.941676:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+9:14441:x1874755972090624:12345-192.168.204.20@tcp:700:lfs.0 Request processed in 382us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907107.941685:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:2.0:1787907107.949442:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907107.949602:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972090880 00000100:00100000:0.0:1787907107.949614:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972090880 00000100:00100000:0.0:1787907107.949690:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1787907107.949700:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+9:14441:x1874755972090880:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:0.0:1787907107.949760:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787907107.949786:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1800/0x72bb6cf063cae64d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efa46 expref: 9 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.949807:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:0.0:1787907107.950122:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787907107.951110:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.951134:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1c00/0x72bb6cf063cae685 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaa8 expref: 5 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.951143:0:14377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.951185:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1c00/0x72bb6cf063cae685 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaa8 expref: 5 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.951201:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1c00/0x72bb6cf063cae685 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaa8 expref: 5 pid: 14377 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907107.951230:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d60000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1874756000397824:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787907107.951341:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534d663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787907107.963532:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907107.963620:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972091008 00000100:00100000:1.0:1787907107.963632:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972091008 00000100:00080000:3.0:1787907107.963695:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787907107.963705:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1c00/0x72bb6cf063cae685 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaa8 expref: 6 pid: 14377 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907107.963754:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1787907107.963764:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:2346:x1874755972091008:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787907107.963782:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787907107.963788:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1c00/0x72bb6cf063cae685 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaa8 expref: 6 pid: 14377 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.963804:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1c00/0x72bb6cf063cae685 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaa8 expref: 6 pid: 14377 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.963882:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:1.0:1787907107.963887:0:14362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.963898:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.963906:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907107.963924:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787907107.963997:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:2346:x1874755972091008:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 234us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907107.964005:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00010000:00010000:0.0:1787907107.965125:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1c00/0x72bb6cf063cae685 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaa8 expref: 5 pid: 14377 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907107.965147:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d60000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1874756000397824:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787907107.965174:0:14377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.965183:0:14377:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.965188:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.965467:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae726 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.965481:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae726 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.965491:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae726 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787907107.974695:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787907107.974718:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.974730:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.974750:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.974756:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403746e00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787907107.974761:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.974769:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.974788:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069ca800) 00010000:00010000:0.0:1787907107.974791:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787907107.974796:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.974802:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae71f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787907107.974871:0:14377:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000281464aa reply state 00000000ee8f2fdf transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae726 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907107.974882:0:14377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787907107.975055:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+10:14441:x1874755972090880:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 25352us (25621us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787907107.975065:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00010000:00010000:0.0:1787907107.977180:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae726 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.977202:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae726 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.977231:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae726 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.977238:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403747c00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787907107.977242:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae726 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.977251:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae726 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.977305:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8aa50a6b4000) 00010000:00010000:0.0:1787907107.977308:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787907107.977314:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae726 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907107.977339:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae726 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907108.002139:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000397952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787907108.002223:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907108.002279:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000397952 00000100:00100000:1.0:1787907108.002288:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000397952 00000100:00100000:1.0:1787907108.003081:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787907108.003098:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53495c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000397952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787907108.003151:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787907108.003561:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000398080:0@lo:400:kworker.0 00000100:00100000:2.0:1787907108.003619:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907108.003667:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000398592:0@lo:400:kworker.0 00000100:00100000:2.0:1787907108.003702:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907108.003703:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000398336:0@lo:400:kworker.0 00000100:00100000:2.0:1787907108.003737:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787907108.003746:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000398208:0@lo:400:kworker.0 00000100:00100000:3.0:1787907108.003754:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907108.003795:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907108.003955:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53495c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000397952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 343us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907108.004032:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787907108.004066:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787907108.004081:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000398464:0@lo:400:kworker.0 00000100:00100000:1.0:1787907108.004110:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907108.004114:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000398080 00000100:00100000:2.0:1787907108.004121:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000398080 00000100:00100000:2.0:1787907108.004154:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787907108.004161:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3303:x1874756000398080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787907108.004164:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000397952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787907108.004201:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3303:x1874756000398080:12345-0@lo:400:kworker.0 Request processed in 40us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907108.004207:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787907108.004244:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000398080:0@lo:400:kworker.0 00000100:00100000:3.0:1787907108.004674:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000398592 00000100:00100000:3.0:1787907108.004680:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000398592 00000100:00100000:3.0:1787907108.004714:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000398336 00000100:00100000:3.0:1787907108.004718:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000398336 00000100:00100000:3.0:1787907108.004733:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000398464 00000100:00100000:3.0:1787907108.004736:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000398464 00000100:00100000:3.0:1787907108.004760:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787907108.004764:0:14378:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787907108.004769:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000398592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907108.004776:0:14378:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787907108.004842:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000398592:12345-0@lo:400:kworker.0 Request processed in 75us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907108.004850:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787907108.004863:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787907108.004869:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000398336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787907108.004901:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874756000398336:12345-0@lo:400:kworker.0 Request processed in 32us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907108.004906:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787907108.004931:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874756000398336:0@lo:400:kworker.0 00000100:00100000:3.0:1787907108.004951:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787907108.004959:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000398464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907108.005174:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000398592:0@lo:400:kworker.0 00000100:00100000:0.0:1787907108.005339:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000398208 00000100:00100000:0.0:1787907108.005344:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000398208 00000100:00100000:0.0:1787907108.005380:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787907108.005388:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000398208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907108.005435:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000398208:12345-0@lo:400:kworker.0 Request processed in 49us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907108.005442:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787907108.005473:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000398208:0@lo:400:kworker.0 00000100:00100000:3.0:1787907108.006009:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874756000398464:12345-0@lo:400:kworker.0 Request processed in 1049us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907108.006020:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787907108.008783:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874756000398464:0@lo:400:kworker.0 00000100:00080000:3.0:1787907108.013861:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1787907108.049896:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000100:00100000:3.0:1787907108.080596:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907108.080809:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972091136 00000100:00100000:2.0:1787907108.080863:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972091136 00000100:00100000:2.0:1787907108.080923:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:2.0:1787907108.080934:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:14449:x1874755972091136:12345-192.168.204.20@tcp:101:lctl.0 00010000:00010000:2.0:1787907108.080972:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907108.081002:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0400/0x72bb6cf063cae72d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efad2 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.081084:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0c00/0x72bb6cf063cae734 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.081100:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0c00/0x72bb6cf063cae734 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.081113:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0c00/0x72bb6cf063cae734 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787907108.081415:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787907108.081420:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787907108.081525:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0c00/0x72bb6cf063cae734 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.081557:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0400/0x72bb6cf063cae72d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efad2 expref: 9 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.081579:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0c00/0x72bb6cf063cae734 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efad2 expref: 8 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.081588:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069cab00) 00010000:00010000:2.0:1787907108.081592:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787907108.081597:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd0c00, rc 0) 00000100:00100000:2.0:1787907108.081698:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+8:14449:x1874755972091136:12345-192.168.204.20@tcp:101:lctl.0 Request processed in 764us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907108.081706:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:2.0:1787907108.114250:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907108.114479:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972091264 00000100:00100000:3.0:1787907108.114490:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972091264 00000100:00100000:3.0:1787907108.114552:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:3.0:1787907108.114562:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+5:14450:x1874755972091264:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787907108.114582:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787907108.114608:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae73b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efad9 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.114674:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994a00/0x72bb6cf063cae742 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.114688:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994a00/0x72bb6cf063cae742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.114701:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994a00/0x72bb6cf063cae742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787907108.114946:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787907108.114951:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787907108.115044:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994a00/0x72bb6cf063cae742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.115072:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae73b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efad9 expref: 7 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.115089:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994a00/0x72bb6cf063cae742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efad9 expref: 6 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.115098:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069cab00) 00010000:00010000:3.0:1787907108.115100:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787907108.115112:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511994a00, rc 0) 00000100:00100000:3.0:1787907108.115168:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:14450:x1874755972091264:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 607us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907108.115175:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:1.0:1787907108.124207:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907108.128160:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972091392 00000100:00100000:2.0:1787907108.128177:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972091392 00000100:00100000:2.0:1787907108.128239:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:2.0:1787907108.128251:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+6:14450:x1874755972091392:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787907108.128275:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907108.128378:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0400/0x72bb6cf063cae749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efae0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.128445:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae750 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.128458:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.128469:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.128483:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae757 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.128491:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.128498:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130415:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae75e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130440:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae75e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130451:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae75e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787907108.130569:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787907108.130574:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787907108.130653:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae75e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130666:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130673:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae750 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130679:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae750 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130685:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd0000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787907108.130689:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae750 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130696:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae750 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130708:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069cab00) 00010000:00010000:2.0:1787907108.130711:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787907108.130715:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130731:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130745:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130751:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae757 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130756:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130761:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd1a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787907108.130764:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130770:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae757 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130777:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8aa5069ca900) 00010000:00010000:2.0:1787907108.130780:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787907108.130783:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae757 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.130789:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae757 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.131715:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0400/0x72bb6cf063cae749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efae0 expref: 8 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.131755:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae75e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efae0 expref: 7 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.131764:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:2.0:1787907108.131767:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787907108.131769:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd1000, rc 0) 00000100:00100000:2.0:1787907108.132563:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+7:14450:x1874755972091392:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 4308us (8370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907108.132574:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:3.0:1787907108.139561:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907108.139605:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972091648 00000100:00100000:3.0:1787907108.139617:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972091648 00000100:00100000:3.0:1787907108.139687:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:3.0:1787907108.139698:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+7:14450:x1874755972091648:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787907108.139723:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787907108.139742:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efae7 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787907108.140467:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787907108.140758:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae765 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efae7 expref: 9 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.140779:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069cab00) 00010000:00010000:3.0:1787907108.140782:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787907108.140787:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efae7 expref: 9 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.140804:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511994600, rc 0) 00000100:00100000:3.0:1787907108.141051:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+8:14450:x1874755972091648:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1218us (1365us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787907108.141064:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:3.0:1787907108.148576:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907108.149006:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972091904 00000100:00100000:0.0:1787907108.149043:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972091904 00000100:00100000:0.0:1787907108.149147:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:0.0:1787907108.149162:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7105112f-1b7f-4c1e-bd83-6e301c02c68b+8:14450:x1874755972091904:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:0.0:1787907108.149244:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787907108.149718:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae75e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efae0 expref: 8 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.149742:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa5069cae00) 00010000:00010000:0.0:1787907108.149753:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787907108.149780:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae773 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.149793:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae773 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.149804:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae773 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787907108.150503:0:14377:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042d20236 reply state 000000000db27ca1 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae773 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907108.150515:0:14377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787907108.150585:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787907108.150712:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7105112f-1b7f-4c1e-bd83-6e301c02c68b+9:14450:x1874755972091904:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 1551us (2145us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787907108.150720:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00010000:00010000:1.0:1787907108.153879:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae773 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907108.153898:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae773 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907108.153906:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae773 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907108.153912:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403746c00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907108.153916:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae773 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907108.153924:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae773 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907108.153945:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa50a6b4000) 00010000:00010000:1.0:1787907108.153948:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787907108.153955:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae773 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907108.153961:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae773 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907108.154380:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907108.154758:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972092160 00000100:00100000:2.0:1787907108.154769:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972092160 00000100:00100000:2.0:1787907108.154874:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:2.0:1787907108.154886:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+8:14450:x1874755972092160:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1787907108.157276:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+9:14450:x1874755972092160:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 2371us (2881us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787907108.157296:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:2.0:1787907108.170586:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907108.170776:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972092416 00000100:00100000:3.0:1787907108.170787:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972092416 00000100:00100000:3.0:1787907108.171072:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:3.0:1787907108.171086:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+9:14450:x1874755972092416:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1787907108.171127:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787907108.171159:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae77a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efaee expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.171270:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae781 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.171547:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae781 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.171563:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae781 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.171580:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995600/0x72bb6cf063cae788 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.171587:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995600/0x72bb6cf063cae788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.171594:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995600/0x72bb6cf063cae788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787907108.172379:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787907108.172565:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae781 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172576:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae781 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172591:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae781 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172598:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511994e00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787907108.172603:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae781 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172611:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae781 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172631:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069cab00) 00010000:00010000:3.0:1787907108.172635:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787907108.172640:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae781 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172647:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae781 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172665:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995600/0x72bb6cf063cae788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172671:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995600/0x72bb6cf063cae788 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172677:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995600/0x72bb6cf063cae788 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172681:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511995600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787907108.172684:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995600/0x72bb6cf063cae788 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172699:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995600/0x72bb6cf063cae788 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172707:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8aa504ed7d00) 00010000:00010000:3.0:1787907108.172710:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787907108.172713:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995600/0x72bb6cf063cae788 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172719:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995600/0x72bb6cf063cae788 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172771:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae77a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaee expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172783:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069cab00) 00010000:00010000:3.0:1787907108.172786:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787907108.172790:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae77a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaee expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907108.172802:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511994600, rc 0) 00000100:00100000:3.0:1787907108.172943:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+10:14450:x1874755972092416:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1857us (2367us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787907108.172952:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:2.0:1787907108.180004:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907108.180207:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972092544 00000100:00100000:0.0:1787907108.180219:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972092544 00000100:00100000:0.0:1787907108.180313:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:0.0:1787907108.180334:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+10:14450:x1874755972092544:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1787907108.180391:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907108.180425:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746800/0x72bb6cf063cae796 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efaf5 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.180537:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746a00/0x72bb6cf063cae79d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.180553:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746a00/0x72bb6cf063cae79d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.180565:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746a00/0x72bb6cf063cae79d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787907108.180780:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787907108.180784:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787907108.180909:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746a00/0x72bb6cf063cae79d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.180943:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746800/0x72bb6cf063cae796 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaf5 expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.181164:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746a00/0x72bb6cf063cae79d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaf5 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.181175:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa50a6b4d00) 00010000:00010000:0.0:1787907108.181177:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787907108.181181:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa403746a00, rc 0) 00000100:00100000:0.0:1787907108.181270:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+11:14450:x1874755972092544:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 939us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907108.181279:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:0.0:1787907108.193642:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907108.193848:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972092672 00000100:00100000:3.0:1787907108.193862:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972092672 00000100:00100000:3.0:1787907108.193929:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:3.0:1787907108.193941:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7105112f-1b7f-4c1e-bd83-6e301c02c68b+11:14450:x1874755972092672:12345-192.168.204.20@tcp:37:lfs.0 00000100:00100000:1.0:1787907108.219682:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7105112f-1b7f-4c1e-bd83-6e301c02c68b+11:14450:x1874755972092672:12345-192.168.204.20@tcp:37:lfs.0 Request processed in 25728us (26036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907108.219702:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:2.0:1787907108.226992:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907108.230186:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972092928 00000100:00100000:0.0:1787907108.230207:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972092928 00000100:00100000:0.0:1787907108.230373:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:0.0:1787907108.230389:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5102be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+11:14450:x1874755972092928:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1787907108.231070:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5102be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7105112f-1b7f-4c1e-bd83-6e301c02c68b+12:14450:x1874755972092928:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 680us (4083us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787907108.231079:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00010000:00010000:1.0:1787907108.260145:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787907108.355081:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907108.355866:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972093056 00000100:00100000:2.0:1787907108.355879:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972093056 00000100:00100000:2.0:1787907108.355946:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:2.0:1787907108.355957:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+8:14456:x1874755972093056:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1787907108.355979:0:16601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907108.356002:0:16601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae7a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efafc expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.356081:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae7ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.356094:0:16601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae7ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.356106:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae7ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.356120:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae7b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.356127:0:16601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.356133:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.358796:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1e00/0x72bb6cf063cae7b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.360338:0:16601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1e00/0x72bb6cf063cae7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.360359:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1e00/0x72bb6cf063cae7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787907108.360636:0:16601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787907108.360641:0:16601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787907108.360764:0:16601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1e00/0x72bb6cf063cae7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.360800:0:16601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae7ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.362613:0:16601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae7ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.362623:0:16601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae7ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.362629:0:16601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd0000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787907108.362634:0:16601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae7ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.362642:0:16601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae7ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.362660:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069cab00) 00010000:00010000:2.0:1787907108.362663:0:16601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787907108.362667:0:16601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae7ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.362674:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae7ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.362693:0:16601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.362700:0:16601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae7b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.362705:0:16601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae7b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.362725:0:16601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd0a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787907108.362728:0:16601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae7b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.362734:0:16601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae7b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.362741:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8aa5069ca900) 00010000:00010000:2.0:1787907108.362744:0:16601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787907108.362746:0:16601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae7b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.362751:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae7b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.364751:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae7a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efafc expref: 10 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.364789:0:16601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1e00/0x72bb6cf063cae7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efafc expref: 9 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.364799:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa50a6b4d00) 00010000:00010000:2.0:1787907108.364810:0:16601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787907108.364838:0:16601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd1e00, rc 0) 00000100:00100000:2.0:1787907108.364940:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+9:14456:x1874755972093056:12345-192.168.204.20@tcp:101:bash.0 Request processed in 8984us (9883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907108.364950:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:3.0:1787907108.375676:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907108.375855:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972093312 00000100:00100000:0.0:1787907108.375866:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972093312 00000100:00100000:0.0:1787907108.375933:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:0.0:1787907108.375944:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+9:14456:x1874755972093312:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1787907108.375968:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907108.375990:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746800/0x72bb6cf063cae7c0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb03 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.376431:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.376452:0:14378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746a00/0x72bb6cf063cae79d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaf5 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.376463:0:14378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.376518:0:14378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746a00/0x72bb6cf063cae79d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaf5 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.376548:0:14378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746a00/0x72bb6cf063cae79d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaf5 expref: 11 pid: 14378 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907108.376570:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d60000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1874756000398720:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787907108.376704:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534d66c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787907108.393919:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907108.394112:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d60000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1874756000398720:192.168.204.20@tcp:104: 00010000:00010000:0.0:1787907108.394151:0:14378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907108.394250:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972093440 00000100:00100000:1.0:1787907108.394271:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972093440 00010000:00010000:1.0:1787907108.394331:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746a00/0x72bb6cf063cae79d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaf5 expref: 12 pid: 14378 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907108.394371:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:1.0:1787907108.394381:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508203b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+12:2345:x1874755972093440:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787907108.394397:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787907108.394405:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746a00/0x72bb6cf063cae79d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaf5 expref: 12 pid: 14378 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907108.394417:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746a00/0x72bb6cf063cae79d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaf5 expref: 12 pid: 14378 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907108.394440:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746a00/0x72bb6cf063cae79d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efaf5 expref: 12 pid: 14378 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907108.394457:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa50a6b4d00) 00010000:00010000:1.0:1787907108.394462:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907108.394472:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907108.394490:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907108.394516:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787907108.394579:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508203b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+11:2345:x1874755972093440:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 199us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907108.394595:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00010000:00010000:0.0:1787907108.394701:0:14378:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.394709:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.394731:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7ce lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.394740:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.394749:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.395864:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae7d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.395877:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.395893:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787907108.395905:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787907108.395934:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.395940:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.395947:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.395953:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403746200 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787907108.395957:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.395964:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.395975:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa50a6b4d00) 00010000:00010000:0.0:1787907108.395978:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787907108.395982:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.395987:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae7c7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787907108.395999:0:14378:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000165cd4a1 reply state 00000000a2469a7a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907108.396017:0:14378:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787907108.396056:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746800/0x72bb6cf063cae7c0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb03 expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.396073:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb03 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.396081:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:0.0:1787907108.396083:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787907108.396086:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa403746c00, rc 0) 00000100:00100000:0.0:1787907108.396140:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+12:14456:x1874755972093312:12345-192.168.204.20@tcp:101:bash.0 Request processed in 20197us (20483us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787907108.396149:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00010000:00010000:0.0:1787907108.399225:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.399245:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7ce lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.399251:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7ce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.399257:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403747600 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787907108.399261:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7ce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.399269:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7ce lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.399325:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8aa50a6b4300) 00010000:00010000:0.0:1787907108.399329:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787907108.399335:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7ce lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.399341:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7ce lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907108.409793:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907108.410024:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972093568 00000100:00100000:0.0:1787907108.410037:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972093568 00000100:00100000:0.0:1787907108.410121:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:0.0:1787907108.410134:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+11:14456:x1874755972093568:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1787907108.410162:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907108.410192:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb0a expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.410285:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746800/0x72bb6cf063cae7ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.410300:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746800/0x72bb6cf063cae7ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.410324:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746800/0x72bb6cf063cae7ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787907108.410374:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787907108.410378:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787907108.410400:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746800/0x72bb6cf063cae7ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.410431:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746800/0x72bb6cf063cae7ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.410458:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb0a expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.410494:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746800/0x72bb6cf063cae7ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb0a expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.410503:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:0.0:1787907108.410506:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787907108.410511:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa403746800, rc 0) 00000100:00100000:0.0:1787907108.410575:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+12:14456:x1874755972093568:12345-192.168.204.20@tcp:101:bash.0 Request processed in 443us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907108.410584:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:3.0:1787907108.414895:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907108.415393:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972093824 00000100:00100000:1.0:1787907108.415407:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972093824 00000100:00100000:1.0:1787907108.415520:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:1.0:1787907108.415532:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+12:14456:x1874755972093824:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:1.0:1787907108.416343:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+13:14456:x1874755972093824:12345-192.168.204.20@tcp:35:bash.0 Request processed in 809us (1453us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787907108.416353:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:3.0:1787907108.542518:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907108.542972:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972094080 00000100:00100000:2.0:1787907108.543007:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972094080 00000100:00100000:2.0:1787907108.543111:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:2.0:1787907108.543125:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+13:14466:x1874755972094080:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787907108.543177:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907108.543211:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae7f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb11 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787907108.543508:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787907108.543697:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae7f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb11 expref: 15 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.543718:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069cab00) 00010000:00010000:2.0:1787907108.543722:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787907108.543730:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae7f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb11 expref: 15 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.543749:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd0a00, rc 0) 00000100:00100000:2.0:1787907108.544461:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+14:14466:x1874755972094080:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1334us (1950us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787907108.544471:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:3.0:1787907108.548548:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907108.548765:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972094336 00000100:00100000:0.0:1787907108.548779:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972094336 00000100:00100000:0.0:1787907108.549132:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:0.0:1787907108.549147:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+14:14466:x1874755972094336:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1787907108.552294:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+15:14466:x1874755972094336:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 3132us (3743us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787907108.552322:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:3.0:1787907108.615211:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907108.615486:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972094592 00000100:00100000:0.0:1787907108.615503:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972094592 00000100:00100000:0.0:1787907108.615604:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:0.0:1787907108.615616:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+15:14469:x1874755972094592:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1787907108.615676:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907108.615707:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7ff lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb18 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.615889:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae806 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.615903:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae806 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.615924:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae806 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787907108.615938:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787907108.616343:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae7ff lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb18 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907108.616370:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae806 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb18 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907108.616380:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:1.0:1787907108.616383:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787907108.616387:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa403746200, rc 0) 00000100:00100000:1.0:1787907108.616758:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+17:14469:x1874755972094592:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1142us (1561us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787907108.616767:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:3.0:1787907108.630272:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907108.630341:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907108.630387:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972094720 00000100:00100000:0.0:1787907108.630413:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972094720 00000100:00100000:2.0:1787907108.630422:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972094848 00000100:00100000:2.0:1787907108.630427:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972094848 00000100:00100000:0.0:1787907108.630497:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:2.0:1787907108.630498:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:0.0:1787907108.630510:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+18:14469:x1874755972094720:12345-192.168.204.20@tcp:54:lfs.0 00000100:00100000:2.0:1787907108.630511:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508203480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+18:2345:x1874755972094848:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787907108.630534:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787907108.630572:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae806 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb18 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.630597:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae814 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907108.630622:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:2.0:1787907108.630630:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787907108.630720:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508203480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+17:2345:x1874755972094848:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 212us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907108.630729:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00010000:00010000:0.0:1787907108.630759:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae814 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.630773:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae814 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.630860:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae814 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.630869:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae814 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.630883:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae814 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.630890:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403746e00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:0.0:1787907108.630894:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae814 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.630902:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae814 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.630911:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:0.0:1787907108.630914:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787907108.630918:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae814 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907108.630924:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746e00/0x72bb6cf063cae814 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907108.630962:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+16:14469:x1874755972094720:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 455us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907108.630968:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:3.0:1787907108.636994:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907108.644210:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972095104 00000100:00100000:1.0:1787907108.644243:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972095104 00000100:00100000:1.0:1787907108.644355:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:1.0:1787907108.644369:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+16:14469:x1874755972095104:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1787907108.644735:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+17:14469:x1874755972095104:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 368us (7754us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787907108.644763:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000040:00080000:0.0:1787907108.704587:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787907109.092963:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907109.093110:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972095360 00000100:00100000:2.0:1787907109.093125:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972095360 00000100:00100000:2.0:1787907109.093224:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:2.0:1787907109.093239:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+17:14500:x1874755972095360:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:2.0:1787907109.093274:0:16601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907109.093314:0:16601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae81b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb1f expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.093445:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae822 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.093460:0:16601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae822 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.093473:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae822 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787907109.093486:0:16601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787907109.093654:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae81b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb1f expref: 20 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.093673:0:16601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae822 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb1f expref: 19 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.093698:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:2.0:1787907109.093701:0:16601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787907109.093705:0:16601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd0000, rc 0) 00000100:00100000:2.0:1787907109.093785:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+19:14500:x1874755972095360:12345-192.168.204.20@tcp:101:cat.0 Request processed in 551us (846us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787907109.093792:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00080000:3.0:1787907109.094568:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787907109.103122:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907109.103243:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972095488 00000100:00100000:1.0:1787907109.103255:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972095488 00000100:00100000:1.0:1787907109.103339:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:1.0:1787907109.103351:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508201500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+19:2343:x1874755972095488:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787907109.103371:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787907109.103407:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae822 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb1f expref: 19 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.103429:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:1.0:1787907109.103434:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787907109.103495:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508201500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+18:2343:x1874755972095488:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 146us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907109.103502:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:0.0:1787907109.105171:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907109.105261:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972095744 00000100:00100000:1.0:1787907109.105274:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972095744 00000100:00100000:1.0:1787907109.105346:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1787907109.105358:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+18:14500:x1874755972095744:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:1.0:1787907109.105800:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+19:14500:x1874755972095744:12345-192.168.204.20@tcp:35:cat.0 Request processed in 442us (636us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787907109.105808:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:3.0:1787907109.213146:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907109.213320:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972096000 00000100:00100000:0.0:1787907109.213332:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972096000 00000100:00100000:0.0:1787907109.213417:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:0.0:1787907109.213430:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa508203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+19:14506:x1874755972096000:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1787907109.213465:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907109.213499:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae830 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb26 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907109.213643:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747000/0x72bb6cf063cae837 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907109.213660:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747000/0x72bb6cf063cae837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907109.213673:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747000/0x72bb6cf063cae837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787907109.213687:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787907109.213904:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae830 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb26 expref: 22 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907109.213923:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747000/0x72bb6cf063cae837 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb26 expref: 21 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907109.214000:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:0.0:1787907109.214005:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787907109.214009:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa403747000, rc 0) 00000100:00100000:0.0:1787907109.214092:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa508203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+21:14506:x1874755972096000:12345-192.168.204.20@tcp:101:dd.0 Request processed in 664us (959us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787907109.214100:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:3.0:1787907109.221650:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907109.221977:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972096256 00000100:00100000:2.0:1787907109.221989:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972096256 00000100:00100000:2.0:1787907109.222049:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:2.0:1787907109.222060:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+21:14506:x1874755972096256:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:2.0:1787907109.222121:0:16601:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787907109.222149:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747000/0x72bb6cf063cae837 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb26 expref: 21 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.222171:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746800/0x72bb6cf063cae7ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb0a expref: 20 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.222181:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:2.0:1787907109.222185:0:16601:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787907109.222581:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae845 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.222595:0:16601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae845 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.222604:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae845 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787907109.222668:0:16601:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787907109.222706:0:16601:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068435591 reply state 00000000773edbf9 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae845 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907109.222714:0:16601:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787907109.222862:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+22:14506:x1874755972096256:12345-192.168.204.20@tcp:36:dd.0 Request processed in 753us (1171us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787907109.222870:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00000020:00080000:2.0:1787907109.222875:0:16601:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787907109.225853:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae845 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.225872:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae845 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.225904:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae845 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.225910:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd0a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907109.225917:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae845 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.225926:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae845 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.225955:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:1.0:1787907109.225959:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907109.225963:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae845 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.225969:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae845 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.280286:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787907109.341910:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907109.342581:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972096512 00000100:00100000:1.0:1787907109.342597:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972096512 00000100:00100000:1.0:1787907109.342679:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1787907109.342692:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+21:14506:x1874755972096512:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:1.0:1787907109.343120:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+22:14506:x1874755972096512:12345-192.168.204.20@tcp:35:dd.0 Request processed in 429us (1224us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1787907109.343127:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:3.0:1787907109.689184:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907109.689363:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972096640 00000100:00100000:2.0:1787907109.689374:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972096640 00000100:00100000:2.0:1787907109.689444:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:2.0:1787907109.689455:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+22:14520:x1874755972096640:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:2.0:1787907109.689479:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907109.689501:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae84c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb2d expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.689568:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae853 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.689581:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae853 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.689591:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae853 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.689604:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae85a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.689629:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae85a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.689636:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae85a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.689730:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0400/0x72bb6cf063cae861 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.689738:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0400/0x72bb6cf063cae861 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.689744:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0400/0x72bb6cf063cae861 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787907109.689779:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787907109.689784:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787907109.690163:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0400/0x72bb6cf063cae861 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690176:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0400/0x72bb6cf063cae861 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690184:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae853 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690190:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae853 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690197:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae853 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690211:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd0000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787907109.690216:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae853 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690223:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae853 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690247:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa50a6b4d00) 00010000:00010000:2.0:1787907109.690250:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787907109.690255:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae853 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690261:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae853 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690275:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae85a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690282:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae85a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690297:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae85a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690303:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd1a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787907109.690306:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae85a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690312:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae85a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690329:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8aa5069ca900) 00010000:00010000:2.0:1787907109.690331:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787907109.690334:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae85a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690340:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae85a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690372:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae84c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb2d expref: 24 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690385:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0400/0x72bb6cf063cae861 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb2d expref: 23 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.690393:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:2.0:1787907109.690395:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787907109.690397:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd0400, rc 0) 00000100:00100000:2.0:1787907109.690462:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+23:14520:x1874755972096640:12345-192.168.204.20@tcp:101:stat.0 Request processed in 1009us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907109.690470:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:3.0:1787907109.763332:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907109.764696:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972096896 00000100:00100000:1.0:1787907109.764713:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972096896 00000100:00100000:1.0:1787907109.764797:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:1.0:1787907109.764842:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+23:14526:x1874755972096896:12345-192.168.204.20@tcp:36:truncate.0 00010000:00010000:1.0:1787907109.764914:0:14379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787907109.765119:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0400/0x72bb6cf063cae861 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb2d expref: 23 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.765144:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:1.0:1787907109.765150:0:14379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787907109.765550:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae868 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.765564:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae868 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.765573:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae868 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787907109.765621:0:14379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1787907109.765645:0:14379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006c510de reply state 00000000deb20ccd transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae868 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907109.765656:0:14379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787907109.765779:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+25:14526:x1874755972096896:12345-192.168.204.20@tcp:36:truncate.0 Request processed in 965us (2457us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787907109.765788:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 37 00000020:00080000:1.0:1787907109.765793:0:14379:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787907109.771774:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae868 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.771793:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae868 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.771802:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae868 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.771868:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fb000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787907109.771873:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae868 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.771881:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae868 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.771899:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:2.0:1787907109.771902:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787907109.771907:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae868 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907109.771913:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae868 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907109.986662:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907109.986788:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972097024 00000100:00100000:1.0:1787907109.986797:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972097024 00000100:00100000:1.0:1787907109.986897:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:1.0:1787907109.986907:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+24:14540:x1874755972097024:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:1.0:1787907109.986932:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907109.986966:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae86f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb34 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987054:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae876 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987071:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae876 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987083:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae876 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987098:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae87d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987105:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae87d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987112:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae87d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987212:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae884 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987221:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae884 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987228:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae884 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787907109.987264:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787907109.987269:0:14377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787907109.987310:0:14377:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae884 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987330:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae884 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987339:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae876 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987346:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae876 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987353:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae876 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987359:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fba00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907109.987363:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae876 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987371:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae876 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987383:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa50a6b4d00) 00010000:00010000:1.0:1787907109.987386:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907109.987391:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae876 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987397:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae876 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987412:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae87d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987418:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae87d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987430:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae87d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987435:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421faa00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907109.987438:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae87d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987445:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae87d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987453:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8aa504dd3800) 00010000:00010000:1.0:1787907109.987456:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907109.987459:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae87d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987465:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae87d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987499:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae86f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb34 expref: 26 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987513:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae884 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb34 expref: 25 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907109.987521:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:1.0:1787907109.987523:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787907109.987526:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa5421fb000, rc 0) 00000100:00100000:1.0:1787907109.987593:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+25:14540:x1874755972097024:12345-192.168.204.20@tcp:101:stat.0 Request processed in 686us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907109.987609:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:3.0:1787907110.127066:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907110.127191:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972097280 00000100:00100000:2.0:1787907110.127202:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972097280 00000100:00100000:2.0:1787907110.127274:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:2.0:1787907110.127297:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+25:14550:x1874755972097280:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1787907110.127327:0:16601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907110.127352:0:16601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae88b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb3b expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787907110.127502:0:16601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787907110.127731:0:16601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae88b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb3b expref: 27 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.127749:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069cab00) 00010000:00010000:2.0:1787907110.127769:0:16601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787907110.127776:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae88b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb3b expref: 27 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.127794:0:16601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd0a00, rc 0) 00000100:00100000:2.0:1787907110.130754:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+26:14550:x1874755972097280:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 3448us (3688us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1787907110.130767:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:3.0:1787907110.139714:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907110.150390:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972097536 00000100:00100000:0.0:1787907110.150410:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972097536 00000100:00100000:0.0:1787907110.150481:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1787907110.150492:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5102be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+26:14550:x1874755972097536:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1787907110.150871:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5102be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+27:14550:x1874755972097536:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 378us (11172us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787907110.150895:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:3.0:1787907110.238040:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907110.238416:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972097792 00000100:00100000:1.0:1787907110.238428:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972097792 00000100:00100000:1.0:1787907110.238501:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:1.0:1787907110.238512:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+27:14556:x1874755972097792:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1787907110.238542:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907110.238563:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae899 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb42 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.238681:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.238696:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae7d5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb03 expref: 28 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.238705:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae884 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb34 expref: 28 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.238716:0:14377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.238772:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae884 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb34 expref: 28 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.238795:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae884 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb34 expref: 28 pid: 14377 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907110.238863:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1874756000398848:192.168.204.20@tcp:104: 00010000:00010000:1.0:1787907110.239012:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb03 expref: 28 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.239023:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae7d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb03 expref: 28 pid: 14378 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907110.239032:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1874756000398976:192.168.204.20@tcp:104: 00000100:00100000:1.0:1787907110.239057:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5072050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787907110.244231:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907110.244356:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972097920 00000100:00100000:0.0:1787907110.244367:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972097920 00010000:00010000:0.0:1787907110.244412:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae884 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb34 expref: 29 pid: 14377 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907110.244458:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:0.0:1787907110.244468:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa5062b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+29:2344:x1874755972097920:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787907110.244484:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787907110.244492:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae884 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb34 expref: 29 pid: 14377 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907110.244506:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae884 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb34 expref: 29 pid: 14377 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907110.244528:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:0.0:1787907110.244533:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907110.244542:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907110.244548:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787907110.244615:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa5062b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+29:2344:x1874755972097920:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 148us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907110.244622:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:3.0:1787907110.247349:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1787907110.248538:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae884 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb34 expref: 28 pid: 14377 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907110.248567:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1874756000398848:192.168.204.20@tcp:104: 00000100:00100000:1.0:1787907110.248580:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1874756000398976:192.168.204.20@tcp:104: 00010000:00010000:1.0:1787907110.248604:0:14377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907110.254113:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972098048 00000100:00100000:2.0:1787907110.254129:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972098048 00010000:00010000:2.0:1787907110.254183:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae7d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb03 expref: 28 pid: 14378 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907110.254238:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:2.0:1787907110.254248:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+28:2344:x1874755972098048:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787907110.254266:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787907110.254273:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae7d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb03 expref: 28 pid: 14378 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.254301:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb03 expref: 28 pid: 14378 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.254325:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae7d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb03 expref: 28 pid: 14378 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.254342:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:2.0:1787907110.254348:0:14363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.254370:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.254377:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.254414:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787907110.254481:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+27:2344:x1874755972098048:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 234us (7142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907110.254489:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00010000:00010000:1.0:1787907110.254511:0:14377:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.254520:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787907110.254538:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1787907110.254692:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae899 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb42 expref: 28 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.254708:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb42 expref: 27 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.254722:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:1.0:1787907110.254725:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787907110.254728:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa5421faa00, rc 0) 00000100:00100000:1.0:1787907110.254755:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+27:14556:x1874755972097792:12345-192.168.204.20@tcp:101:bash.0 Request processed in 16246us (16726us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1787907110.254762:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:0.0:1787907110.264534:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907110.265063:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972098304 00000100:00100000:2.0:1787907110.265074:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972098304 00000100:00100000:2.0:1787907110.265140:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:2.0:1787907110.265151:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+27:14556:x1874755972098304:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:2.0:1787907110.265450:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae8ae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.265469:0:16601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae8ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.265480:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae8ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787907110.265532:0:16601:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1787907110.265558:0:16601:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d447b8b6 reply state 0000000002e55a88 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae8ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907110.265567:0:16601:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787907110.265669:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+30:14556:x1874755972098304:12345-192.168.204.20@tcp:36:bash.0 Request processed in 519us (1154us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1787907110.265685:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00000020:00080000:2.0:1787907110.265690:0:16601:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787907110.268078:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae8ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.268116:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae8ae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.268122:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae8ae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.268129:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd0a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787907110.268134:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae8ae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.268142:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae8ae lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.268160:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:3.0:1787907110.268163:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787907110.268168:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae8ae lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.268173:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0a00/0x72bb6cf063cae8ae lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907110.269658:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907110.269922:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972098432 00000100:00100000:2.0:1787907110.269932:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972098432 00000100:00100000:2.0:1787907110.269993:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:2.0:1787907110.270004:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+29:14556:x1874755972098432:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1787907110.270029:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907110.270049:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae8b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb49 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.270116:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae8b5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb49 expref: 30 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.270130:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae8b5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb49 expref: 30 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.270150:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:2.0:1787907110.270154:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787907110.270157:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd0000, rc 0) 00000100:00100000:2.0:1787907110.270222:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+30:14556:x1874755972098432:12345-192.168.204.20@tcp:101:bash.0 Request processed in 219us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907110.270230:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:2.0:1787907110.277941:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907110.278074:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972098560 00000100:00100000:3.0:1787907110.278086:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972098560 00000100:00100000:3.0:1787907110.278157:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:3.0:1787907110.278175:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+30:14556:x1874755972098560:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1787907110.278206:0:16601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787907110.278239:0:16601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae8bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb50 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.278364:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae8c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.278395:0:16601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb42 expref: 31 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.278404:0:16601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae8c3 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.278441:0:16601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb42 expref: 31 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.278455:0:16601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb42 expref: 31 pid: 14377 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907110.278468:0:16601:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ee5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16601:1874756000399104:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787907110.278545:0:16601:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa402c06c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787907110.282608:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907110.282719:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972098688 00000100:00100000:1.0:1787907110.282730:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972098688 00010000:00010000:1.0:1787907110.282772:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb42 expref: 32 pid: 14377 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907110.282862:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:1.0:1787907110.282874:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+32:2346:x1874755972098688:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787907110.282891:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787907110.282898:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb42 expref: 32 pid: 14377 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.282923:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb42 expref: 32 pid: 14377 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.282946:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:1.0:1787907110.282952:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae8c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.282961:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.282988:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae8c3 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.283010:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787907110.283067:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+32:2346:x1874755972098688:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 195us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907110.283074:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00010000:00010000:3.0:1787907110.283307:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421faa00/0x72bb6cf063cae8a0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb42 expref: 31 pid: 14377 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907110.283326:0:16601:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ee5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16601:1874756000399104:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787907110.283348:0:16601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.283357:0:16601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.283363:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787907110.283424:0:16601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787907110.283437:0:16601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787907110.283465:0:16601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.283497:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae8bc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb50 expref: 31 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.283513:0:16601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae8c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb50 expref: 30 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.283521:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:3.0:1787907110.283524:0:16601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787907110.283526:0:16601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511994e00, rc 0) 00000100:00100000:3.0:1787907110.283557:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+30:14556:x1874755972098560:12345-192.168.204.20@tcp:101:bash.0 Request processed in 5389us (5629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907110.283565:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:0.0:1787907110.288466:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907110.291737:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972098944 00000100:00100000:3.0:1787907110.291757:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972098944 00000100:00100000:2.0:1787907110.296001:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:2.0:1787907110.296021:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+30:14556:x1874755972098944:12345-192.168.204.20@tcp:103:bash.0 00010000:00010000:2.0:1787907110.296043:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787907110.296098:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994e00/0x72bb6cf063cae8c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb50 expref: 30 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.296126:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae8b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb49 expref: 29 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.296137:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa50a6b4b00) 00010000:00010000:2.0:1787907110.296150:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787907110.296228:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+28:14556:x1874755972098944:12345-192.168.204.20@tcp:103:bash.0 Request processed in 214us (7772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907110.296236:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:0.0:1787907110.301859:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907110.301958:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972099072 00000100:00100000:2.0:1787907110.301970:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972099072 00000100:00100000:2.0:1787907110.302033:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:2.0:1787907110.302045:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+28:14556:x1874755972099072:12345-192.168.204.20@tcp:58:bash.0 00010000:00010000:2.0:1787907110.302163:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae8ca lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.302180:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae8ca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.302193:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae8ca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787907110.303221:0:14378:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787907110.303412:0:14378:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787907110.303487:0:14378:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787907110.303601:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+28:14556:x1874755972099072:12345-192.168.204.20@tcp:58:bash.0 Request processed in 1552us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907110.303622:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00010000:00010000:3.0:1787907110.305132:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787907110.307573:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907110.307666:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972099200 00000100:00100000:3.0:1787907110.307678:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972099200 00000100:00100000:3.0:1787907110.307742:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:3.0:1787907110.307753:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+28:14556:x1874755972099200:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1787907110.307777:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787907110.307841:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae8d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb57 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.307906:0:14379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae8ca lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.307948:0:14379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae8d1 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb57 expref: 29 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.307969:0:14379:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae8ca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.307984:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae8d1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb57 expref: 29 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.307998:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787907110.308001:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787907110.308005:0:14379:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae8d1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb57 expref: 29 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.308013:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511994600, rc 0) 00000100:00100000:3.0:1787907110.308075:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+29:14556:x1874755972099200:12345-192.168.204.20@tcp:101:bash.0 Request processed in 324us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907110.308082:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000040:00080000:0.0:1787907110.754569:0:14411:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787907110.754581:0:14411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787907110.754653:0:14411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787907110.754660:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787907110.756222:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d61880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14411:1874756000399232:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787907110.758192:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa52124b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787907110.777886:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907110.778524:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972099328 00000100:00100000:3.0:1787907110.778539:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972099328 00000100:00100000:3.0:1787907110.778618:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1787907110.778632:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+30:14557:x1874755972099328:12345-192.168.204.20@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787907110.778751:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+30:14557:x1874755972099328:12345-192.168.204.20@tcp:900:lhsmtool_posix.0 Request processed in 122us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907110.778759:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1787907110.782344:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907110.782619:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972099456 00000100:00100000:1.0:1787907110.782631:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972099456 00000100:00100000:1.0:1787907110.782714:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:1.0:1787907110.782730:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+30:14557:x1874755972099456:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787907110.782774:0:14378:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787907110.783797:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d61880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14411:1874756000399232:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787907110.786322:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+29:14557:x1874755972099456:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 3583us (3978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907110.786338:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:3.0:1787907110.797086:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907110.797662:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972099584 00000100:00100000:1.0:1787907110.797675:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972099584 00000100:00100000:1.0:1787907110.797775:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:1.0:1787907110.797797:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+29:14557:x1874755972099584:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787907110.797916:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae8d8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.797936:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae8d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.797952:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae8d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798054:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae8df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798064:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae8df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798071:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae8df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798328:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae8e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798339:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798347:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787907110.798396:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787907110.798400:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787907110.798414:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798425:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae8d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798431:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae8d8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798439:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae8d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798456:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fac00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907110.798461:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae8d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798470:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae8d8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798484:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa504dd3f00) 00010000:00010000:1.0:1787907110.798488:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907110.798493:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae8d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798508:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae8d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798526:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae8df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798531:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae8df lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798537:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae8df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798542:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fb000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907110.798545:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae8df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798551:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae8df lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798569:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8aa504dd3800) 00010000:00010000:1.0:1787907110.798571:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907110.798574:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae8df lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798580:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae8df lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798598:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798603:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae8e6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798608:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798612:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fba00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907110.798615:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798621:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae8e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798628:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:1.0:1787907110.798630:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907110.798633:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae8e6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.798639:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae8e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907110.799025:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+29:14557:x1874755972099584:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 1228us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907110.799035:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:2.0:1787907110.805638:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907110.805746:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972099840 00000100:00100000:3.0:1787907110.805761:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972099840 00000100:00100000:3.0:1787907110.805866:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:3.0:1787907110.805877:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+29:14557:x1874755972099840:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787907110.805898:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787907110.805929:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994800/0x72bb6cf063cae8ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb5e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.806065:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cae8f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.806335:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cae8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.806350:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cae8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787907110.806365:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787907110.806491:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cae8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.806501:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cae8f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.806508:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cae8f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.806513:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511995400 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:3.0:1787907110.806519:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cae8f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.806552:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cae8f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.806569:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:3.0:1787907110.806572:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787907110.806578:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cae8f4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.806586:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511995400/0x72bb6cf063cae8f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.806655:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994800/0x72bb6cf063cae8ed lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb5e expref: 31 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.806667:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa504dd3f00) 00010000:00010000:3.0:1787907110.806669:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787907110.806674:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994800/0x72bb6cf063cae8ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb5e expref: 31 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.806684:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa511994800, rc 0) 00000100:00100000:3.0:1787907110.807570:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+30:14557:x1874755972099840:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1684us (1935us total) trans 8589934619 rc 301/301 00000100:00100000:3.0:1787907110.807584:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:3.0:1787907110.811776:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907110.813731:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972099968 00000100:00100000:2.0:1787907110.813752:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972099968 00000100:00100000:2.0:1787907110.814361:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:2.0:1787907110.814378:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+30:14557:x1874755972099968:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787907110.814780:0:16601:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787907110.815219:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+30:14557:x1874755972099968:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 840us (3451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907110.815232:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:0.0:1787907110.824214:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907110.824369:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972100224 00000100:00100000:1.0:1787907110.824384:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972100224 00000100:00100000:1.0:1787907110.824782:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:1.0:1787907110.825107:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+30:14557:x1874755972100224:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787907110.825134:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907110.825160:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae902 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb65 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787907110.826677:0:14378:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1787907110.826692:0:14378:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1787907110.826759:0:14378:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1787907110.827495:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae909 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.827520:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae909 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.827536:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae909 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.827639:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae902 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb65 expref: 33 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.827662:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae909 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb65 expref: 32 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.827688:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa504dd3800) 00010000:00010000:1.0:1787907110.827691:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787907110.827695:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa5421fb000, rc 0) 00000100:00100000:1.0:1787907110.828044:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+32:14557:x1874755972100224:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 2940us (3845us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787907110.828056:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:2.0:1787907110.833602:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907110.833688:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972100480 00000100:00100000:1.0:1787907110.833700:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972100480 00000100:00100000:1.0:1787907110.833797:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:1.0:1787907110.833808:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+32:14557:x1874755972100480:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787907110.834590:0:14379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787907110.834632:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae909 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb65 expref: 32 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.834659:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa504dd3800) 00010000:00010000:1.0:1787907110.834670:0:14379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787907110.834696:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae917 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.834712:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae917 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.834724:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae917 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.834802:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae91e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfcf34b0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.834877:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae91e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfcf34b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.834886:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae91e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfcf34b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.835163:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae917 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.835172:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae917 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.835180:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae917 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.835187:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fac00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907110.835193:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae917 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.835202:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae917 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.835212:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa50a6b4d00) 00010000:00010000:1.0:1787907110.835215:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907110.835219:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae917 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.835225:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae917 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.835238:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae91e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfcf34b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.835252:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae91e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfcf34b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.835259:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae91e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfcf34b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.835274:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fae00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907110.835277:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae91e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfcf34b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.835284:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae91e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfcf34b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.835293:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xfcf34b0b (ffff8aa504dd3600) 00010000:00010000:1.0:1787907110.835296:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907110.835298:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae91e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfcf34b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.835304:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae91e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfcf34b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907110.835767:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+31:14557:x1874755972100480:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1956us (2177us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787907110.835776:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:2.0:1787907110.840393:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907110.840524:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972100608 00000100:00100000:3.0:1787907110.840540:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972100608 00000100:00100000:2.0:1787907110.840739:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:2.0:1787907110.840754:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+31:14557:x1874755972100608:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787907110.840805:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907110.840858:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1c00/0x72bb6cf063cae925 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb6c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.841122:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1800/0x72bb6cf063cae92c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.841141:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1800/0x72bb6cf063cae92c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.841158:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1800/0x72bb6cf063cae92c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.841341:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1c00/0x72bb6cf063cae925 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb6c expref: 33 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.841367:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1800/0x72bb6cf063cae92c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb6c expref: 32 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.841377:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:2.0:1787907110.841380:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787907110.841385:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd1800, rc 0) 00000100:00100000:2.0:1787907110.841544:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+32:14557:x1874755972100608:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 792us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907110.841554:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:0.0:1787907110.846484:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907110.846737:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972100864 00000100:00100000:3.0:1787907110.846752:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972100864 00000100:00100000:3.0:1787907110.846930:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:3.0:1787907110.846945:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+32:14557:x1874755972100864:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787907110.847078:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994800/0x72bb6cf063cae933 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.847097:0:16601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994800/0x72bb6cf063cae933 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907110.847109:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994800/0x72bb6cf063cae933 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787907110.847666:0:16601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1787907110.847680:0:16601:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 549119866468ns, next at 550119862909ns, rc = 0 00000004:00010000:3.0:1787907110.847793:0:16601:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb4b087a reply state 00000000dc82c9bd transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994800/0x72bb6cf063cae933 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907110.847804:0:16601:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787907110.847971:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+34:14557:x1874755972100864:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1026us (1504us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1787907110.847981:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00010000:00010000:2.0:1787907110.852102:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994800/0x72bb6cf063cae933 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.852130:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994800/0x72bb6cf063cae933 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.852140:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994800/0x72bb6cf063cae933 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.852147:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511994800 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787907110.852153:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994800/0x72bb6cf063cae933 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.852162:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994800/0x72bb6cf063cae933 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.852186:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:2.0:1787907110.852210:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787907110.852217:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994800/0x72bb6cf063cae933 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907110.852223:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994800/0x72bb6cf063cae933 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907110.854802:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907110.855067:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972100992 00000100:00100000:1.0:1787907110.855081:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972100992 00000100:00100000:1.0:1787907110.855156:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:1.0:1787907110.855168:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+33:14557:x1874755972100992:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787907110.855203:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907110.855255:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae93a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb73 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.855354:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae93a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb73 expref: 34 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.855369:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae93a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb73 expref: 34 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.855391:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:1.0:1787907110.855395:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787907110.855399:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa5421fae00, rc 0) 00000100:00100000:1.0:1787907110.855473:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+34:14557:x1874755972100992:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 308us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907110.855480:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:3.0:1787907110.860102:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907110.860278:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972101120 00000100:00100000:0.0:1787907110.860292:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972101120 00000100:00100000:0.0:1787907110.860403:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:0.0:1787907110.860421:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+5:2345:x1874755972101120:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787907110.860987:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:2345:x1874755972101120:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 570us (898us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787907110.860999:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00080000:3.0:1787907110.861659:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787907110.866508:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907110.866678:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972101376 00000100:00100000:0.0:1787907110.866692:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972101376 00000100:00100000:0.0:1787907110.866895:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:0.0:1787907110.866920:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+34:14557:x1874755972101376:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787907110.867708:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+35:14557:x1874755972101376:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 787us (1213us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787907110.867728:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1787907110.871725:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907110.872182:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972101632 00000100:00100000:1.0:1787907110.872195:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972101632 00000100:00100000:1.0:1787907110.872274:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:1.0:1787907110.872286:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+35:14557:x1874755972101632:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787907110.872460:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+35:14557:x1874755972101632:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 175us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907110.872469:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:3.0:1787907110.881349:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907110.881703:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972101760 00000100:00100000:1.0:1787907110.881713:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972101760 00000100:00100000:1.0:1787907110.881788:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:1.0:1787907110.881800:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+35:14557:x1874755972101760:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787907110.882295:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907110.882326:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae941 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb7a expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907110.882432:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae948 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907110.882450:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae948 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907110.882462:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae948 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787907110.882503:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787907110.882524:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae948 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907110.882551:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746200/0x72bb6cf063cae941 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb7a expref: 37 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907110.882570:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae948 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb7a expref: 36 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907110.882579:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:0.0:1787907110.882581:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787907110.882584:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa403747600, rc 0) 00000100:00100000:0.0:1787907110.882656:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+36:14557:x1874755972101760:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 859us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907110.882683:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:3.0:1787907110.886481:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907110.887344:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972101888 00000100:00100000:1.0:1787907110.887373:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972101888 00000100:00100000:1.0:1787907110.887548:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:1.0:1787907110.887559:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:2345:x1874755972101888:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787907110.887577:0:15060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907110.887598:0:15060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fa7bb06/0x72bb6cf063cae94f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb81 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787907110.887626:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a914c26, blocks: 0x1 00010000:00010000:1.0:1787907110.887649:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1787907110.887653:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907110.887663:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fa7bb06/0x72bb6cf063cae94f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb81 expref: 7 pid: 15060 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.887682:0:15060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006fa7bb06/0x72bb6cf063cae94f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb81 expref: 7 pid: 15060 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907110.887696:0:15060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa5421fac00, rc 0) 00000100:00100000:1.0:1787907110.887763:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:2345:x1874755972101888:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 206us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907110.887770:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1787907110.895795:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907110.896114:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972102144 00000100:00100000:2.0:1787907110.896127:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972102144 00000100:00100000:2.0:1787907110.896206:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:2.0:1787907110.896216:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+36:14557:x1874755972102144:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787907110.896357:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+36:14557:x1874755972102144:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 141us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907110.896364:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:3.0:1787907110.905150:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907110.908213:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972102272 00000100:00100000:0.0:1787907110.908234:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972102272 00000100:00100000:0.0:1787907110.908343:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:0.0:1787907110.908355:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+36:14557:x1874755972102272:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787907110.925238:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907110.925289:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907110.925316:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907110.925344:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972102400 00000100:00100000:2.0:1787907110.925353:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972102400 00000100:00100000:2.0:1787907110.925397:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:2.0:1787907110.925408:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:2346:x1874755972102400:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1787907110.925476:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf71194-8f86-474c-b7fd-37f1c612ad57+13:2346:x1874755972102400:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907110.925484:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:2.0:1787907110.925534:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907110.925620:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907110.926036:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972102528 00000100:00100000:3.0:1787907110.926041:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972102528 00000100:00100000:3.0:1787907110.926082:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972102784 00000100:00100000:3.0:1787907110.926085:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972102784 00000100:00100000:3.0:1787907110.926097:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972102912 00000100:00100000:3.0:1787907110.926099:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972102912 00000100:00100000:3.0:1787907110.926112:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:3.0:1787907110.926119:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+5:2346:x1874755972102528:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787907110.926154:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+5:2346:x1874755972102528:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 36us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907110.926161:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:3.0:1787907110.926172:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:3.0:1787907110.926177:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+5:2346:x1874755972102784:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787907110.926196:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+5:2346:x1874755972102784:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 19us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907110.926202:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:3.0:1787907110.926211:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:3.0:1787907110.926216:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+5:2346:x1874755972102912:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1787907110.926233:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7105112f-1b7f-4c1e-bd83-6e301c02c68b+5:2346:x1874755972102912:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 18us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907110.926238:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00080000:3.0:1787907110.926332:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787907110.926337:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787907110.926860:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972102656 00000100:00100000:0.0:1787907110.926868:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972102656 00000100:00100000:0.0:1787907110.926924:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:0.0:1787907110.926934:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7105112f-1b7f-4c1e-bd83-6e301c02c68b+11:2346:x1874755972102656:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1787907110.926983:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7105112f-1b7f-4c1e-bd83-6e301c02c68b+11:2346:x1874755972102656:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 52us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907110.926989:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00080000:1.0:1787907110.927247:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1787907110.983311:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000001:00080000:3.0:1787907110.983347:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:3.0:1787907110.984256:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787907110.984633:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000399360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787907110.984925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907110.985180:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000399360 00000100:00100000:1.0:1787907110.985190:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000399360 00000100:00100000:1.0:1787907110.985281:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787907110.985293:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874756000399360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787907110.985518:0:15062:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787907110.985595:0:15062:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787907110.985598:0:15062:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787907110.985600:0:15062:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787907110 -> 1787907110 00002000:00010000:1.0:1787907110.985603:0:15062:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787907110.985662:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874756000399360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 371us (739us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787907110.985671:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1787907110.986226:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa507ccb100/2, rc 0, transno 8589934595 00000100:00100000:2.0:1787907110.986237:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874756000399360:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1787907110.986258:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787907110.987240:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+13:14557:x1874755972102272:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 78879us (82102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907110.987252:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:0.0:1787907110.992607:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907110.995772:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972103040 00000100:00100000:1.0:1787907110.995799:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972103040 00000100:00100000:1.0:1787907110.996003:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:1.0:1787907110.996020:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:2345:x1874755972103040:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787907110.996386:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:2345:x1874755972103040:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 370us (3795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907110.996395:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:3.0:1787907111.006917:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907111.007079:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972103296 00000100:00100000:2.0:1787907111.007090:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972103296 00000100:00100000:2.0:1787907111.007302:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00080000:1.0:1787907111.007307:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787907111.007315:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+13:14557:x1874755972103296:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787907111.007382:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787907111.007414:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747600/0x72bb6cf063cae948 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb7a expref: 13 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.007432:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:2.0:1787907111.007437:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787907111.007464:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae956 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.007477:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae956 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.007487:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae956 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787907111.007701:0:14377:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0104d85 reply state 00000000876d5cfd transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae956 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907111.007711:0:14377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787907111.007872:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+14:14557:x1874755972103296:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 560us (971us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1787907111.007896:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00010000:00010000:1.0:1787907111.011035:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae956 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.011059:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae956 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.011067:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae956 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.011072:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd0000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907111.011077:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae956 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.011106:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae956 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.011124:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:1.0:1787907111.011127:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907111.011131:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae956 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.011137:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd0000/0x72bb6cf063cae956 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907111.011563:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907111.011673:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972103424 00000100:00100000:1.0:1787907111.011683:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972103424 00000100:00100000:1.0:1787907111.011741:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:1.0:1787907111.011752:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:14557:x1874755972103424:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787907111.011977:0:15062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787907111.011996:0:15062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bd776e1/0x72bb6cf063cae95d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb88 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.012026:0:15062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006fa7bb06/0x72bb6cf063cae94f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb81 expref: 8 pid: 15060 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.012034:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907111.012039:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787907111.012043:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd776e1/0x72bb6cf063cae95d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb88 expref: 8 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.012090:0:15062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006fa7bb06/0x72bb6cf063cae94f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb81 expref: 8 pid: 15060 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.012104:0:15062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006fa7bb06/0x72bb6cf063cae94f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb81 expref: 8 pid: 15060 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907111.012120:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15062:1874756000399488:192.168.204.20@tcp:104: 00000100:00100000:1.0:1787907111.012216:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5420c9600 going to sleep for 11 seconds 00000100:00100000:1.0:1787907111.017132:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15062:1874756000399488:192.168.204.20@tcp:104: 00010000:00010000:1.0:1787907111.017188:0:15062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001bd776e1/0x72bb6cf063cae95d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb88 expref: 8 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.017222:0:15062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa5421fba00, rc 0) 00000100:00100000:1.0:1787907111.017322:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+8:14557:x1874755972103424:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 5571us (5762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907111.017332:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:3.0:1787907111.019593:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907111.019731:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972103552 00000100:00100000:2.0:1787907111.019744:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972103552 00010000:00010000:2.0:1787907111.019792:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006fa7bb06/0x72bb6cf063cae94f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb81 expref: 8 pid: 15060 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907111.019852:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:2.0:1787907111.019863:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+8:2345:x1874755972103552:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787907111.019879:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787907111.019907:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006fa7bb06/0x72bb6cf063cae94f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb81 expref: 8 pid: 15060 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.019922:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006fa7bb06/0x72bb6cf063cae94f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb81 expref: 8 pid: 15060 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.019950:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fa7bb06/0x72bb6cf063cae94f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb81 expref: 8 pid: 15060 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.019974:0:14363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907111.019981:0:14363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907111.019989:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001bd776e1/0x72bb6cf063cae95d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb88 expref: 7 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.020002:0:14363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd776e1/0x72bb6cf063cae95d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb88 expref: 7 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.020087:0:14363:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001bd776e1/0x72bb6cf063cae95d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb88 expref: 7 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907111.020106:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f7eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14363:1874756000399616:192.168.204.20@tcp:105: 00000100:00100000:2.0:1787907111.020859:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5361619c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787907111.026750:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f7eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14363:1874756000399616:192.168.204.20@tcp:105: 00010000:00010000:2.0:1787907111.026780:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787907111.026889:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:2345:x1874755972103552:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 7027us (7309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907111.026900:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:3.0:1787907111.035247:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907111.035345:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972103680 00000100:00100000:2.0:1787907111.035360:0:16300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972103680 00000100:00100000:2.0:1787907111.035599:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1787907111.035614:0:16300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:2346:x1874755972103680:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787907111.036683:0:16300:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787907111.036690:0:16300:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787907110 00002000:00010000:3.0:1787907111.036693:0:16300:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787907108 00002000:00010000:3.0:1787907111.036695:0:16300:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787907110 -> 1787907110 00002000:00010000:3.0:1787907111.036697:0:16300:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787907111.037171:0:16300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+8:2346:x1874755972103680:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 1554us (1934us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787907111.037183:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:0.0:1787907111.044514:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907111.045064:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972103808 00000100:00100000:3.0:1787907111.045078:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972103808 00000100:00100000:3.0:1787907111.045223:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:3.0:1787907111.045237:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+8:2345:x1874755972103808:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787907111.045294:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000424c82b1/0x72bb6cf063cae964 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.045317:0:15060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001bd776e1/0x72bb6cf063cae95d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb88 expref: 8 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.045327:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787907111.045332:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787907111.045337:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000424c82b1/0x72bb6cf063cae964 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.045376:0:15060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001bd776e1/0x72bb6cf063cae95d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb88 expref: 8 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.045416:0:15060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001bd776e1/0x72bb6cf063cae95d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb88 expref: 8 pid: 15062 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907111.045433:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa520aff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15060:1874756000399744:192.168.204.20@tcp:104: 00000100:00100000:3.0:1787907111.045535:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa402c06600 going to sleep for 11 seconds 00000100:00100000:0.0:1787907111.050689:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907111.054525:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa520aff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15060:1874756000399744:192.168.204.20@tcp:104: 00010000:00010000:3.0:1787907111.054583:0:15060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000424c82b1/0x72bb6cf063cae964 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907111.056352:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972103936 00000100:00100000:1.0:1787907111.056373:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972103936 00010000:00010000:1.0:1787907111.056460:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001bd776e1/0x72bb6cf063cae95d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb88 expref: 9 pid: 15062 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907111.056525:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:1.0:1787907111.056539:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+9:2346:x1874755972103936:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787907111.056585:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787907111.056619:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001bd776e1/0x72bb6cf063cae95d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb88 expref: 9 pid: 15062 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.056637:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001bd776e1/0x72bb6cf063cae95d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb88 expref: 9 pid: 15062 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.056665:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd776e1/0x72bb6cf063cae95d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb88 expref: 9 pid: 15062 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.056697:0:14362:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787907111.056703:0:14362:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787907111.056710:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000424c82b1/0x72bb6cf063cae964 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.056722:0:14362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000424c82b1/0x72bb6cf063cae964 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.056768:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787907111.056908:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+8:2346:x1874755972103936:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 370us (7150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907111.056918:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00010000:00010000:3.0:1787907111.056999:0:15060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000424c82b1/0x72bb6cf063cae964 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.057013:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000424c82b1/0x72bb6cf063cae964 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.057050:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000424c82b1/0x72bb6cf063cae964 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.057059:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000424c82b1/0x72bb6cf063cae964 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.057067:0:15060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000424c82b1/0x72bb6cf063cae964 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.057090:0:15060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa511995800 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907111.057095:0:15060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000424c82b1/0x72bb6cf063cae964 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.057111:0:15060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000424c82b1/0x72bb6cf063cae964 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.057125:0:15060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000424c82b1/0x72bb6cf063cae964 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.057132:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000424c82b1/0x72bb6cf063cae964 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907111.057197:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:2345:x1874755972103808:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 11962us (12695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907111.057206:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:2.0:1787907111.067368:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907111.068515:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972104192 00000100:00100000:0.0:1787907111.068532:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972104192 00000100:00100000:0.0:1787907111.068618:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:0.0:1787907111.068631:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+13:14557:x1874755972104192:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787907111.068716:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae96b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907111.068737:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae96b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907111.068752:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae96b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907111.069126:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907111.069154:0:14379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae93a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb73 expref: 14 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907111.069163:0:14379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907111.069206:0:14379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae93a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb73 expref: 14 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907111.069222:0:14379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae93a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb73 expref: 14 pid: 14378 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787907111.069239:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa534d62300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14379:1874756000399872:192.168.204.20@tcp:104: 00000100:00100000:0.0:1787907111.072178:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa534e49780 going to sleep for 11 seconds 00000100:00100000:0.0:1787907111.075091:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1787907111.075246:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972104320 00000100:00100000:3.0:1787907111.075297:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972104320 00010000:00010000:3.0:1787907111.075362:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae93a lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb73 expref: 15 pid: 14378 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787907111.075423:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:3.0:1787907111.075436:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+15:2346:x1874755972104320:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787907111.075458:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787907111.075490:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae93a lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb73 expref: 15 pid: 14378 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.075507:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae93a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb73 expref: 15 pid: 14378 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.075537:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:3.0:1787907111.075548:0:14363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.075562:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.075571:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.075603:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787907111.075683:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+15:2346:x1874755972104320:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 250us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907111.075691:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00010000:00010000:2.0:1787907111.075890:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae93a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb73 expref: 14 pid: 14378 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907111.075918:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa534d62300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14379:1874756000399872:192.168.204.20@tcp:104: 00010000:00010000:2.0:1787907111.075953:0:14379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.075966:0:14379:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.075984:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787907111.076283:0:14379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1787907111.077344:0:14379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1787907111.077498:0:14379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1787907111.077630:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f7ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14379:1874756000400000:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787907111.079088:0:14379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787907111.079374:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000400000 00000100:00100000:3.0:1787907111.079387:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000400000 00000100:00100000:3.0:1787907111.079465:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787907111.079478:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14379:x1874756000400000:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787907111.080652:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa5361619c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787907111.084420:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14379:x1874756000400000:12345-0@lo:1000:mdt00_002.0 Request processed in 4926us (5319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787907111.084443:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787907111.088799:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f7ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14379:1874756000400000:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787907111.092569:0:14379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1787907111.092703:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f7ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14379:1874756000400128:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787907111.092803:0:14379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907111.092899:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161180 going to sleep for 11 seconds 00000100:00100000:1.0:1787907111.093114:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000400128 00000100:00100000:1.0:1787907111.093124:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000400128 00000100:00100000:1.0:1787907111.093180:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787907111.093191:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14379:x1874756000400128:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787907111.093473:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14379:x1874756000400128:12345-0@lo:1000:mdt00_002.0 Request processed in 281us (667us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787907111.093483:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787907111.095849:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f7ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14379:1874756000400128:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787907111.095925:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.095938:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.095947:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.095953:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403746c00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787907111.095959:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.096201:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.096225:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:2.0:1787907111.096229:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787907111.096235:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.096242:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403746c00/0x72bb6cf063cae972 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.096310:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae8ca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.096322:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae8ca lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.096328:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae8ca lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.096333:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd1000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787907111.096336:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae8ca lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.096343:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae8ca lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.096352:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:2.0:1787907111.096355:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787907111.096365:0:14379:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae8d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb57 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.096390:0:14379:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae8d1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb57 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.096401:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae8d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb57 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.096510:0:14379:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa511994600/0x72bb6cf063cae8d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb57 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907111.096531:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53f7edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14379:1874756000400256:192.168.204.20@tcp:105: 00000100:00100000:2.0:1787907111.097556:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff8aa536161d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787907111.103258:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907111.103416:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972104448 00000100:00100000:1.0:1787907111.103426:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972104448 00000100:00100000:1.0:1787907111.103491:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1787907111.103502:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+18:14556:x1874755972104448:12345-192.168.204.20@tcp:49:bash.0 00000100:00100000:1.0:1787907111.103920:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+18:14556:x1874755972104448:12345-192.168.204.20@tcp:49:bash.0 Request processed in 418us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907111.103929:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:2.0:1787907111.104180:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53f7edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14379:1874756000400256:192.168.204.20@tcp:105: 00010000:00010000:2.0:1787907111.104213:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae8ca lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104224:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1000/0x72bb6cf063cae8ca lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104255:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae979 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104292:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae979 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104308:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae979 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104318:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae979 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104338:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae979 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104345:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae979 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104352:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa50efd1a00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787907111.104357:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae979 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104364:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae979 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104483:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:2.0:1787907111.104487:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787907111.104490:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae979 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104496:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa50efd1a00/0x72bb6cf063cae979 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104508:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae96b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104514:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae96b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104519:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae96b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104524:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa403747c00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:2.0:1787907111.104534:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae96b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104540:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae96b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104549:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:2.0:1787907111.104551:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787907111.104554:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae96b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.104560:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747c00/0x72bb6cf063cae96b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787907111.105136:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+17:14557:x1874755972104192:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 36503us (37776us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1787907111.105147:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000020:00080000:2.0:1787907111.105152:0:14379:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787907111.106889:0:14411:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787907111.106912:0:14411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787907111.106954:0:14411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787907111.106963:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787907111.114481:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907111.114732:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972104704 00000100:00100000:0.0:1787907111.114745:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972104704 00000100:00100000:1.0:1787907111.114948:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:1.0:1787907111.114964:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa520aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+17:14557:x1874755972104704:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787907111.115947:0:14380:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787907111.116082:0:14380:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1787907111.116148:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae980 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.116173:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae980 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.116189:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae980 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.116201:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae980 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.116209:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae980 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.116231:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae980 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.116256:0:14380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787907111.116414:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa520aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+19:14557:x1874755972104704:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 1449us (1938us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1787907111.116424:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000020:00080000:1.0:1787907111.116432:0:14380:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787907111.117158:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787907111.117176:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae980 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.117185:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fba00 already unused, calling callback (ffffffffc1439230) 00010000:00010000:3.0:1787907111.117190:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae980 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.117198:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae980 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.117216:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa5069ca000) 00010000:00010000:3.0:1787907111.117219:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787907111.117226:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae980 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.117231:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fba00/0x72bb6cf063cae980 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787907111.117251:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907111.117253:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907111.117255:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787907111.117695:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907111.118007:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972104832 00000100:00100000:2.0:1787907111.118020:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972104832 00000100:00100000:2.0:1787907111.118081:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:2.0:1787907111.118093:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+7:14556:x1874755972104832:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1787907111.118119:0:15061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787907111.118149:0:15061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee05a797/0x72bb6cf063cae987 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb8f expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787907111.118186:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a914c26, atime: 0x6a914c24, ctime: 0x6a914c26, blocks: 0x1 00010000:00010000:2.0:1787907111.118211:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787907111.118217:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787907111.118241:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee05a797/0x72bb6cf063cae987 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb8f expref: 8 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.118270:0:15061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ee05a797/0x72bb6cf063cae987 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb8f expref: 8 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787907111.118293:0:15061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa50efd0400, rc 0) 00000100:00100000:2.0:1787907111.118359:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+8:14556:x1874755972104832:12345-192.168.204.20@tcp:101:bash.0 Request processed in 268us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907111.118366:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1787907111.125508:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907111.126125:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972105088 00000100:00100000:1.0:1787907111.126140:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972105088 00000100:00100000:1.0:1787907111.126232:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:1.0:1787907111.126247:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa534d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+19:14556:x1874755972105088:12345-192.168.204.20@tcp:35:bash.0 00000001:00080000:1.0:1787907111.127125:0:14380:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:1.0:1787907111.127416:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa534d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+21:14556:x1874755972105088:12345-192.168.204.20@tcp:35:bash.0 Request processed in 1167us (1918us total) trans 8589934632 rc 0/0 00000100:00100000:1.0:1787907111.127428:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000020:00080000:1.0:1787907111.127437:0:14380:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787907111.227635:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1787907111.227772:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972105344 00000100:00100000:0.0:1787907111.227800:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972105344 00000100:00100000:0.0:1787907111.227937:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:0.0:1787907111.227949:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa507ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+21:14567:x1874755972105344:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1787907111.227982:0:16601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787907111.228008:0:16601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747a00/0x72bb6cf063cae98e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f4aece0155efb96 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787907111.228337:0:16601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787907111.228558:0:16601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747a00/0x72bb6cf063cae98e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb96 expref: 23 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907111.228574:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa5069cab00) 00010000:00010000:0.0:1787907111.228577:0:16601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787907111.228582:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa403747a00/0x72bb6cf063cae98e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x6f4aece0155efb96 expref: 23 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787907111.228596:0:16601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa403747a00, rc 0) 00000100:00100000:0.0:1787907111.228675:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa507ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+22:14567:x1874755972105344:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 728us (1059us total) trans 8589934633 rc 301/301 00000100:00100000:0.0:1787907111.228686:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:2.0:1787907111.233612:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907111.233760:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972105472 00000100:00100000:1.0:1787907111.233786:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972105472 00000100:00100000:1.0:1787907111.234081:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:1.0:1787907111.234096:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+22:14567:x1874755972105472:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:1.0:1787907111.234214:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae99c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.234236:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae99c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.234285:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae99c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.234304:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae9a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.234313:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.234321:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.234683:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae9aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.234694:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae9aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.234701:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae9aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787907111.235324:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae9aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235349:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae99c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235358:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae99c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235367:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae99c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235387:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fae00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907111.235392:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae99c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235400:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae99c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235417:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa50a6b4d00) 00010000:00010000:1.0:1787907111.235420:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907111.235426:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae99c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235433:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fae00/0x72bb6cf063cae99c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235450:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235457:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235464:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235469:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fac00 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907111.235471:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235478:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae9a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235495:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8aa504dd3200) 00010000:00010000:1.0:1787907111.235498:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907111.235501:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae9a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235507:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fac00/0x72bb6cf063cae9a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235524:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae9aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235529:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae9aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235534:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae9aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235538:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa5421fb000 already unused, calling callback (ffffffffc1e784f0) 00010000:00010000:1.0:1787907111.235540:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae9aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235544:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae9aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235551:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa5069ca900) 00010000:00010000:1.0:1787907111.235553:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787907111.235556:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae9aa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787907111.235562:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa5421fb000/0x72bb6cf063cae9aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787907111.235709:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+22:14567:x1874755972105472:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 1610us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907111.235722:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:2.0:1787907111.241232:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907111.241344:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972105728 00000100:00100000:1.0:1787907111.241355:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972105728 00000100:00100000:1.0:1787907111.241411:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:1.0:1787907111.241421:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+22:14567:x1874755972105728:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1787907111.242372:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+23:14567:x1874755972105728:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 947us (1148us total) trans 8589934634 rc 0/0 00000100:00100000:1.0:1787907111.242382:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00010000:00010000:2.0:1787907111.329036:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787907112.353311:0:15545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787907112.609398:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787907112.609432:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000400384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787907112.609525:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907112.609755:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000400384 00000100:00100000:2.0:1787907112.609766:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000400384 00000100:00100000:2.0:1787907112.609858:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787907112.609870:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874756000400384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787907112.609926:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787907112.609986:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874756000400384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907112.609994:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787907112.610019:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787907112.610069:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000400384:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787907112.695741:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:3.0:1787907112.695767:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1787907112.695784:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:02000400:2.0:1787907112.788271:0:16641:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:1.0:1787907113.133442:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000400640:0@lo:400:kworker.0 00000100:00100000:1.0:1787907113.133541:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907113.133602:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000401152:0@lo:400:kworker.0 00000100:00100000:1.0:1787907113.133647:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907113.133680:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787907113.133687:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000400768:0@lo:400:kworker.0 00000100:00100000:2.0:1787907113.133702:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000400512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787907113.133715:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907113.133738:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907113.133738:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53b034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000401280:0@lo:400:kworker.0 00000100:00100000:2.0:1787907113.133757:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa53495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000401024:0@lo:400:kworker.0 00000100:00100000:1.0:1787907113.133762:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787907113.133777:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787907113.133795:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000400768 00000100:00100000:1.0:1787907113.133804:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000400768 00000100:00100000:2.0:1787907113.133827:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787907113.133833:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8aa507ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000400896:0@lo:400:kworker.0 00000100:00100000:2.0:1787907113.133855:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787907113.134038:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000401152 00000100:00100000:0.0:1787907113.134044:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000401152 00000100:00100000:0.0:1787907113.134117:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000401280 00000100:00100000:0.0:1787907113.134121:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000401280 00000100:00100000:0.0:1787907113.134141:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000401024 00000100:00100000:0.0:1787907113.134144:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000401024 00000100:00100000:0.0:1787907113.134163:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787907113.134175:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000401152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907113.134525:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874756000401152:12345-0@lo:400:kworker.0 Request processed in 350us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907113.134534:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787907113.134557:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787907113.134565:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000401280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907113.134597:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874756000401280:12345-0@lo:400:kworker.0 Request processed in 35us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907113.134603:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787907113.134620:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787907113.134627:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000401024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907113.134659:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874756000401024:12345-0@lo:400:kworker.0 Request processed in 32us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907113.134665:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787907113.134725:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874756000401280:0@lo:400:kworker.0 00000100:00100000:0.0:1787907113.134743:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53b036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874756000401152:0@lo:400:kworker.0 00000100:00100000:2.0:1787907113.139241:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa53495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874756000401024:0@lo:400:kworker.0 00000100:00100000:2.0:1787907113.139317:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000400640 00000100:00100000:2.0:1787907113.139325:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000400640 00000100:00100000:2.0:1787907113.139398:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787907113.139410:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa536d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3303:x1874756000400640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787907113.139532:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa536d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ebba1202-2d0e-4d1e-8963-43f853425a20+19:3303:x1874756000400640:12345-0@lo:400:kworker.0 Request processed in 123us (5991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907113.139540:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787907113.139601:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000400512 00000100:00100000:2.0:1787907113.139606:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000400512 00000100:00100000:2.0:1787907113.139647:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787907113.139655:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000400512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787907113.139695:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787907113.139740:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000400512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (6000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907113.139747:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787907113.139771:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787907113.139777:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787907113.139837:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000400512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787907113.139891:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ebba1202-2d0e-4d1e-8963-43f853425a20:3303:1874756000400640:0@lo:400:kworker.0 00000100:00100000:1.0:1787907113.143858:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874756000400896 00000100:00100000:1.0:1787907113.143880:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874756000400896 00000100:00100000:1.0:1787907113.143960:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787907113.143971:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787907113.143978:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000400768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787907113.144007:0:16300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53f7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000400896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787907113.145681:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874756000400896:0@lo:400:kworker.0 00000100:00100000:1.0:1787907113.149566:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874756000400768:12345-0@lo:400:kworker.0 Request processed in 5581us (15833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787907113.149590:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787907113.150908:0:16300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53f7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874756000400896:12345-0@lo:400:kworker.0 Request processed in 6884us (17025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787907113.150927:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787907113.173967:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1787907113.173987:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa507ccb100, transno 8589934595 00000004:00080000:2.0:1787907113.174012:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1787907113.174049:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8aa507cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874756000400768:0@lo:400:kworker.0 00000040:00080000:2.0:1787907113.191166:0:14411:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787907113.191182:0:14411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787907113.191237:0:14411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787907113.191247:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787907113.376312:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787907114.400164:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787907114.507862:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1787907114.507920:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1787907114.514433:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972105856 00000100:00100000:2.0:1787907114.514457:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972105856 00002000:00100000:2.0:1787907114.514557:0:15066:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8aa53b034380 x1874755972105856/t0(0) o4->b3584eb2-bb70-4147-abd7-b7e752b5bc9e@192.168.204.20@tcp:685/0 lens 504/0 e 0 to 0 dl 1787907125 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787907114.514569:0:15066:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa53b034380 with x1874755972105856 ext(0->8) 00002000:00010000:2.0:1787907114.514577:0:15066:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa53b034380 00000100:00100000:2.0:1787907114.514621:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:2.0:1787907114.514634:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+6:2346:x1874755972105856:12345-192.168.204.20@tcp:4:bash.0 00000100:00080000:1.0:1787907114.514850:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787907114.519700:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+8:2346:x1874755972105856:12345-192.168.204.20@tcp:4:bash.0 Request processed in 5047us (11833us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787907114.520955:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00002000:00100000:2.0:1787907114.520980:0:15066:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8aa53b034380 x1874755972105856/t8589934598(0) o4->b3584eb2-bb70-4147-abd7-b7e752b5bc9e@192.168.204.20@tcp:685/0 lens 504/448 e 0 to 0 dl 1787907125 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787907114.520992:0:15066:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa53b034380 with x1874755972105856 ext(0->8) 00002000:00010000:2.0:1787907114.521011:0:15066:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa53b034380 00000100:00100000:2.0:1787907114.521083:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874755972105984 00000100:00100000:2.0:1787907114.521098:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874755972105984 00000100:00100000:2.0:1787907114.521163:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:2.0:1787907114.521175:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa53b037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+8:2346:x1874755972105984:12345-192.168.204.20@tcp:16:kworker.0 00000100:00100000:2.0:1787907114.722464:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa53b037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3584eb2-bb70-4147-abd7-b7e752b5bc9e+8:2346:x1874755972105984:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 201266us (214518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787907114.722482:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000001:00080000:1.0:1787907114.722937:0:6699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed Debug log: 30395 lines, 30395 kept, 0 dropped, 0 bad.